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ABSTRACT 



The present invention provides a platform for resotuce 
allocation in real-time. One or more software resource 
agents interact with software player agents, which are one or 
more of buyers and seller agents, to reach an agreement on 
a price for a specific resource. 
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<?xml verslon="1.0" encoding="UTF-8'' ?> 
- <AuctionPlayer context="http://HOSTNAME:HTTP.PORT/bx/garage''> 
- <SingleFrameGUI> 

<Te)CtPanel name«"News'' helght="50" v(sibie«"true" border^ "false" /> 
<LoglnPanel name^'Xogln" hefght^'^lSO" visible- "true" border="true" /> 
<ResourceAgentPanel nam€="ResourceAgent" helghts-SO" vislble="true" 

borders "true" /> 
<UploadAgentPan€l name= "Garage" helght="80* vlsible="true" 

border='"tru©" /> 
<BldCanvasPanel name="BldCanvas" helght^'lSO" visible^ "false" 
border="true" /> 

- <StrategyChoicePanel name= "Strategies" height="160'' v(slble="true'' 

border="true*> 

<StrategyPanel name=''Manuar strategy="ManualStrategy" /> 
<StrategyPanelNotEditable name="Auto'" strategy^-TruthfulStrategy" J> 
< /Strategy Cho icePa n el > 

- <ValuationChoicePanel na me = "Valuations" helght="240" vlslble="false" 

border=*'true"> 

<WebValuationPanel name="Web Valuation" valuation ="Vi^ebValuation" /> 
<ValuationPanel name="ElastIc Demand" valuation="Roberts Valuation" /> 
<ValuationPanel name="Inelastlc Demand" valuation="LinearValuatlon" }> 
<Budg€tVa(uatlonP3nel name= "Budget Valuation" label="" 
valuation-^BudgetVaiuatlon" /> 
</ValuatlonCholcePanel> 

<PlayerInfoPanei name="Allocatfon" height=''120'' vlsible="true'' 
border="true" /> 

<BudgetPanel name= "Budget" helght="80" vlslble="false" border="true" /> 
<DisplayPaneI name="Units" height="80'' vlslble= "false" border="true" /> 
<IPAddressPanet name»"IP" height="lXO'' visible="false" border="true" /> 
<ConnectionPanel name= ''Connection" helght="X40" visible^^'false" 

bord€r="true" /> 
<BidTablePanel name-"Bid Tabic" height«"400" visible="fa!se" 

border="tnje" /> 
<BldGraphPanel name«"Bid Graph" height="400" visible^ "false" 

border="true" /> 

<AllQcationGraphPanel name="Allocatlon Graph" height="400" visible = "false" 
border="truc" /> 
</SlngleFrameGUI> 

<PlayerIdentity name="USERNAME" passwd="PASSWD" lpaddress="IP_ADDRESS" 
netmask="NETMASK" /> 

- <Lin€arValuatlon labeN''Znelastic Demand"> 

<Parameter namej="qmax" value="45000.0" label-'Kbps" /> 
<Parameter name="vmax" value= "44928.0' label ="$/month" /> 
</LtnearVaiuation> 

- <RobertsValuatlon current="false'' label= ''Elastic Demand" > 

<Parameter name="qmax" value=''45000.0" label ="Kbps" /> 
< Parameter name="vmax" value="4928.0'' labeI=''$/month" /> 
</RobertsValuatlon> 

- <BudgetV/aluation current="true" label="Budget Valuation"> 

<Parameter name="qniax" value="1000.O" labeN'Kbps" /> 
<Parameter name="budget" value="100.0" label="$/month" /> 
</BudgetValuatlon> 
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- <WebValuation label= "Web Valuation" > 
<param name="delay" value="100.0'' /> 
<param name^'hltspermonth" value="10000G.O" /> 
<param name="filesl2e" value="1000,0" /> 
<param name^-centsperhit" value^'O,!** /> 
<param name="randomi2e" value="false" l> 
</WebValuation> 

<Parameter na me =" budget" value="51840.6" label="$/month" /> 
<Manual5trategy current="false" label="Manual" /> 
<TruthfulStrategy current="true" label="Auto" /> 
<resourceAgentURL nickname="RESOURCE_NAME" 

current="truc">http;//HOSTNAME:HTTP_PORT/bx/RESOURCe.NAME</resourceAge 
<uploadURL nickname="HOSTNAME 

garage">http://HOSTNAME:HTTP_PORT/bx/garage</uploadURL> 
<param name="playerlntervar value="2000'* /> 
<param na me = "timeout" value="2000" /> 
<param name="tlmelabel" value="min" /> 
<param name="currencylabci" value="c" /> 
<param name="quantitylaber value="Mbps" /> 
<param name="debug" value="false" /> 
</AuctlonPlayer> 
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* File: Truthful. java- 
nr 

* Remark: Strategy for player with diminishing returns 
■k 

* $Id: Truthful. java,v 1.16 07:43:19 cobe Exp $ 
* 

*/ 

package ihn.merkato; 

import org-w3c .dora. */ 

import com.sun .xml. tree. Xml Document ; 

/* 

* The strategy that bids the truthful best reply as in Proposition 1 o 

f 

* the eSP paper. 

* It will only submit the bid if utility will be increased by at least 

* epsilon, 
*<p> 

*@author Nemo Semret 
*r 

V 

public class Truthful extends AuctionStrategy { 

Bid tmp « createBidO; 
/** 

* Finds truthful best reply as in Proposition 1 of 

* the PSP paper. 

* Sets the bid at the player if utility will be increased by at leas 

t 

* epsilon. 
*<p> 

*• If timelogging is enabled, this will write to the player's 

* log a line with current time, bid, allocation, and utility, 

* at each call. 

* 0see #epsilon 

* Osee ihn*merkato.AuctionPlayer#setBid 
*/ 

public boolean bid() { 

double lq=0, uq= getPlayer ( ) .getValuation ( ) . qmax 0 , mq*- (uq+lq)/2, 
dq = getPlayerO -dqO ; 

if (debug 0) { 

getPlayer (), log ("q range « ["+lq+ 
","+uq+"] dq="+dq+ 
" Q-"+getPlayer ( ) , stuff ( ) ) ; 
getPlayer 0 .addnews (" . ") ; 

) 
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); 



// see Proposition 1 
int i=0; 
double mp, dv; 
while { uq-lq >dq && K20) { 
i++; 

mq « (lq+uq)/2; 
/* 

if (mq < getPlayerO .stuff 0 - , 
^ getBidder ( ) . getBidList ( ) ) . demandAt Price ( 
getPlayer ( ) . dval (mq, mq+dq) , 
getPlayerO .getldO ) ) 

// iLe following is equivalent and more general 

getPlayerO .getldO 

''^etSylr().Iog("i="-HiV- mq="-^-q-" 

if (dv>inp} 
lq=mq; 
else 
uq=mq; 



) 



tmp.bidderid - getPlayer 0 .getid 0 ; 
tmp. price « Data.MAXPRICE; 
tmp.qty = Iq; 

getSidderO .anteBid()+ " found "+tmp) ; 

if(util(tmp) <0] { 
uq= tinp.qty; 
lq=0; 

} 

i«0; 

while {uq-lq>dq i<20> { 
tmp.qty = {uq+lq)/2; 
i++; 

if (utiKtmp) <0) 
uq= tmp^qty; 

else 

Iq = tmp.qty; 
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) 

// need this tn case the above loop is just outside the budget 
whiJe (utiK tmp) <0 « tmp.qty>0 ts i «0) i 
i++; 

tmp.qty — dq; 



''aSiir().log(-'HU" steps, ranges ('HlqH^", "-uq|«l currentbid-^ 
getPlayeru .-Logi getBidderO .anteBidO .qty) ; 

p3Xxtmp.price « getPlayerO.getValuationO.dvalitrap.qty, t.p,qty.dq) ; 

double u = getPlayerO.currentUtilt); 
double newu - util(tmp) ; 

if (debug t)} { , ^ «i 

getPlayerO -1°^ ("=""-J^^^?^der{) .currentAllocation()4 

" newbid="+tmp+" antebid=^" + 
getBidder { ) . anteBid ( ) ) ; 
aetPlayerO . log ( "u«"+u+" newu«"+newu+" ante=" 
getfxayeiw y ^util (getBidder (). anteBid () ) 
^„ fee-"+getBidder(> .bidFeeO 
+" epsilon='"+epsllon() 
+ " avgdur='"+getAvg Duration ( ) ) ; 

} 

"^ir "tr/= getBildl^ ( ! . currentAUocation ( , ; 

getPlayerO -lo^r-^getBidder (Nante^^^ .qty^^^^^^ .p.ice*"\f. 

alloc. qty+"\t"+alloc.price+"\t"+ 
getPlayerO . cur rent Util ( ) ) ; 

) 

/if ( newu > u + epsilonO) { .„^„^ 
\^s^H (^^ i??debug()) getPlayerO. addnewsC-"); 

^ \ rfturHetBidder () .setBid (tmp.qty, tmp.price) , 

( ^^^^if (debug ( ) ) get Player ( ) . addnews 
Y return false; 



} 

) 



04/15/2004, EAST Version: 1.4.1 



Patent Application Publication May 29, 2003 Sheet 17 of 38 US 2003/0101124 Al 



* BidList object 
* 

* File; PSPBidLlst . java 
* 

* 
* 

* * 
* 

* 

package ihn.diffpex? 

import ihn.nierkato.Bid; 
import ihn . merkato . Data ; 

, * 
*. 

*/ 

public class PSPBidList extends ihn.merkato.GenericBidliist { 

* Cott^ute an allocation given the current profile of opponents 

in 

* this bidlist. This class uses the Progressive- Second- Price 

* auction rule. 

* ©param tb The bid for vhich the allocation is to be calculate 

d. 

* ®param Q The total quantity of resource available. 
*/ 

public Bid allocation (Bid tb, double Q) { 
return PSPallocation (tb^ Q) ; 

) 
I 

* Compute an allocation given the current profile of opponents 

in 

* this bidlist, with the Progressive- Second-Price 

* auction rule. 

* oparam tb The bid for which the allocation ie to be calculate 
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d. 

* ©parara Q The total quantity of resource available. 
*/ 

private synchronized Bid PSPallocation(Bid tb, double Q) { 
Bid index ■ top; 
Bid alloc= new Bid(); 

double leftover = Q; //leftover with player id 
double leftoverwo =Q; //leftover without player id 
doubl e qAj , gA j 0 , num* 0 , den« 0 ; 
boolean gotcha = false; 

alloc, qty = Math.min (tb.qty, 

Math . max (Q-demandAt Price ( tb . price , tb . bid 

derid) ,0)) / 

while (index. next != null) { 
index « index. next; 

if (index. bidderid i» tb.bidderid) { 

if (index. price <= tb. price igotcha) { 
leftover tb.qty; 
if (leftover <=0) lef tover=0 ; 
gotcha = true; 

} 

qAj = (index. qty <= leftover ? index. qty : leftover); 
qAjO= (index. qty <«= leftoverwo ? index. qty : leftoverwo); 
num (index. price* (qAjO- qAj)); 
// den (qAjO- qAj); 

leftoverwo -« index, qty; 

leftover -= index. qty; 

if (leftover <=0) lef tover=0; 

if (leftoverwo <«0) lef toverwo=0 ; 

) 



} 

// if (J gotcha) alloc. qty = (tb.qty <= leftover ? tb.qty : 

(3 a) 
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leftover) ; 

// alloc. price = den>0 ? num/den : 0; 

alloc.price = alloc.qty>0 ? num/alloc .qty : 0; 
alloc.bidderid = tb.bidderid; 

return alloc; 

1 



/ 



raids with ID#0 are not counted. 

public double revenue (double Q) { 
Bid index = top; 
dovible r=0; 
int 1=0; 

Bid al; , 
while {index. next != null) { 
index - index. next; 

I++; . f 

if (index. bidderid!=0) { 

al = allocation (index, Q) ; 

r+= al.qty*al. price; 

/ /value (index. bidderid, Q) ; 

} 

} 

return r; 

// if (I==0) return 0; (^.ta.NOBODY. Q) ; 

// else return r -= d 

} 



} 



// substituted 8 float to double 
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<?xml verslon="1.0" encocling="UTF"8" ?> 
- <GenericAuctlonAgent 

context="http://HOSTNAME:HTTP_PORT/bx/RESOURCE_NAME"> 
<PlayerIdentity name=''RESOURCE_USER" passwd="RESOURCE_PASSWD'' 
ipaddress*="127.0.0.l" netmask="255.255.255.255" /> 

- <PSPBidList> 

<param name="randomduratlon'' value="false" /> 
<param name=="duralion" value="60000" /> 
<param name="mustconv" value="true" /> 
<param name="bldfee" value="0.01" /> 
<param name="capacity" values^lOOOO.O" /> 
</PSPBidLlst> 

<UnixCryptAuthenticator passwdfile="MERKATO_HOME/accounts/passwd" /> 

- <LinearValuatlon> 

<Parameter name="qmax" value="QMAX_VAL" label="QMAX.UNITS" /> 
<Parameter name="vmax" value="VMAX_VAr labe!="VMAX.UNITS" /> 

</LinearValuation> 

<param name="accountingDrlverClass" 

value^^ihn.merkato.AccountManager" /> 
<param name="accountFile" 

value="http://HOSTNAME:HTTP_P0RT/bx/dbstub" /> 
<param name="hwDrlverClass" value=''RESOURCE_DRIVER_CLASS" /> 
<param name="hwDevice" value="RESOURCE_DRIVER^INrr'' /> 
<param name="maxNBlds" values^lOO" /> 
<param name="verbose" value="true" /> 
<param name="rememberlds" vaiue="fatee" /> 
<param name="clientTimeoiit" value^^SOOOO" /> 
<param name="serverTlmeout" valuea^SOOOO" /> 
<param name= "pause" value="5000" /> 
<param name="detalledIog" value=''true" /> 
<Paranneter name="maxBidFee" values"!. 0" label="$" /> 
<Parameter name="maxAccountBalance" value="loooo,0" label="$" /> 
</Ge nericAuctlonAgent > 
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HTML - Not Bidding 



Note: All changes require that **Sutiinit" be pressed 
to send change to agent in "garage" 




"Refresh" updates screen 
display 



"Submif * sends new 
values to agent in "garage" 
and exits 



Select "active" to begin 
bidding 

"'Budget" is used to 
calculate price per unit 
bandwidth bid during 
auction. (Must enable 
"active" first). User is 
encouraged to bid high 
during periods of heavy use 
and bid low, or not at all 
during periods of light use. 



Ject the units for the 
display. Previously entered 
values will scale to the 
new units 



There is no cost accrued to buyers who are not bidding. They will be placed in 
the best-effort qtieue until they elect to bid for bandwidth. 

"Submit" updates the budget value of the garaged agent to what you have 
entered into this screen and exits. At this point, it exits to a generic Merkato 
screen, but for customers, it will exit to a StreamingHand page. 
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HTML - Bidding 



Note: AU changes require that**Subinit"be pressed 
to send change to agent in "garage" 




Duration of last bid 
round. Thisdmc 
varies based on how 
active the bidding is 
during a round. 



Refiesh (same 
in in "inactive" 
screen) 



Submit (same 
in in "inactive" 
screen) 



Select "Inactive" to stop 
bidding 

"Budget (same as in 
"inactive;" screen) 

This is the last price offered 
- with quantity desired bid 
(changes often so need to 
'^Refresh"). 

Amount of bandwidth and 
extended price allocated to 
this agent during the last 
auction round 



Units (same in in 
"inactdve" screen) 



User will generally want to bid high during period of heavy use and lower 
during periods of light use. 

The agent will attempt to obtain as much bandwidth as possible without 
exceeding budget. Conversely, the agent will request smaller and smaller 
amounts of bandwidth until they can obtain something for the budget price. 

"Refresh" updates die screen. It does not send any changes to the '^budget" 
value to the garaged agent "Submif * does this (and then exits). 
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Wizard - Bid Window 




Show 
auction 



^Stop 
^ bidding ^ 

Countdown timer Uploads agent 

for current to gai^c where 

auction. Reset it can continue 

whenever a new bidding and 

bid is received exits 



Display 
account 
summary 
screen 



**Budgef* is used to 
calculate price per unit 
bandwidth bid during 
auction. 
This is the last price offered 
with quantity desired bid 
(changes often so need to 
"Refresh"). 

Amount of bandwidth and 
extended price allocated to 
this agent during the last 
auction round 

Select the units for the 
Jisplay. Previously entered 
values will scale to the 
new units 

Display help. When checked, 
mouse-button presses bring up help 
rather than performing function 



"Stop" means to stop bidding. This bidding agent will not be charged and they 
will be placed in the shared bestreffort queue. 

"Upload" uploads the configuration to the garaged agent. Not that this wUl 
chiige some advanced settings to those assumed by this simple valuation and 

Strategy model. 

This simple budget-based valuation model has the bidding agent attempt to get 
as much bandwidth as possible without exceeding the budget number. 
The strategy is based on the formula: price-per-unit-bandwidth * bandwidth- 
allocated = total-price-paid 

Where the total-pricc^paid ("budget") is held constant, and the other two 
variables allowed to be altered. 

FoUowing this strategy, the bidder wUl first attempt to get aU bandwidA 
the seUer is offering for their budgeted amount, which works out to the lowest 
nossible price-per-unit-bandwidth. If unsuccessful, the bidding agent 
gradually increases the offered price-per-unit-bandwidth and decreases the 
desired amount of bandwidth, until they successMly win an allocation. 
If aU bidders foUow this valuation model, they vviU each get a b^dwidth 
allocation that is the same proportion to total bandwidth as their budget is to 
the combined budgets of all bidders. 



From the "Help" screen" 

•Press Start to tell your agent to start bidding for you. 
• Press Stop to tell your agent to stop, 
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"Bid Canvas" Screen 

A dynamic display of the second price auction in progress 



Red circle Uchs bid 
yDttintci)cl,to subaut. 



Sfilid Magorta dot is 
the allocation you 
Tcceived last round 



Magciita circle isihe 
alLocttioii you 
would based on 
your last bid. 



Blae tliaded area 
represents bsndwidcb 
Ulocflted, fron right to 
left If di^crent bidders 
paydifiTctcntunitpriccSr ^ 
it will look like steps;. 
Black space St left 
tndicstes that not alt 
bandwidth was aUocated 
based 00 the cntient bids. 




Hive dots are other bidders. Their position 
repccicnu the qtuntlty ofbandwMch and the 
price per unit bandwidth they offered 



Solid red d9t is ^ur last 
hid. Red munbcr acxt to 
dot ia your bidder ID 
cumber 




Magenta live represents your budget. 
Agent, If anttunued, will never Ud 
above diJs line, regardless of bid 
(valuation)strBtcfy line 



Red line represents 
-bidding (valuation) 
strategy. Your bids. 
If cmtomated, will 
follow this line. 



Far right dot is seller. 
Shows price floor and 
bandwidth bdn^ sold 



Note: Manual bids may be placed by placing your cursor at the posltioD which represents 
your bid and clicldng your moose. 



Red Valuation Line and Magenta Budget line are superimposed when 
**Budget" valuation is being used (default for "HTML" and *Wizard'* Agent 
Interfaces), 

Often the Red circle, red dot and magenta circle will be very close together. 
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Status bar 




"Tickertape" list 
of price bids 

'Allocation last round 

- ID of last bidder 
(active auction) 

Waiting for bid timer to 
expire at end of auction 



- Pause at end of auction 
(for configuration) 

About to receive 
allocation update 
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"Resource Agent" Subscreen 

Selection screen for resource for which you are bidding 




Pull-down menu allows 
you to determine which 
resource you would like 
to bid on. 
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"Units" Subscreen 



Enter the units for 
currency which you 
would like in all 
displays (currently, 
the only option is 



Enter the units for 
bandwidth which you 
would like in all displays 
(options are "Kbps**, 
"Mbps","Gbps") 




Enter the units for 
time which you 
would like in all 
displays (options are 
ms'*- millisec, **scc'\ 
"min","hr^- hours, 
"day", "or *'month")- 



Note; If you change units, any numerical values in any other subscreen will 
automatically be scaled to reflect the units change, but represent the same quantity 
as originally specified. 



r 



t 
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'Budget" subscreen 

Selection screen for bidding "strategy" 



You enter the "maximum cost run 
rate** here - this supercedes any 
higher values that might be derived 
from valuation curves. In other 
words, bids - which consist of a 
price per unit bandwidth and a total 
bandwidth desired - will not be 
placed if they would result in a 
greater pripe than that indicated here, 



When the valuation type is 
"Budget", the **pric& per unit 
time" field cannot be altered 
because it is a duplicate of that 
entered in the valuation 
subscreen. ^ 
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Valuations - Budget Valuation 

Selection screen for bidding "strategy" 




Maximum quantity of 
bandwidth desired (by 
default it is all the 
seller is offering) 

Maximum amount you 
are willing to pay for 
that bandwidth 



This curve represents the value you place on bandwidth based on the ainount you 
receive. The ''budget" valuation curve represents a desire to get the maximum 
amount of bandwidth for a constant price. The "Valuation" curve in the bid 
canvas as your bid strategy is derived from the change in slope of this curve. 
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Valuations - Web Valuation 

Selection screen for bidding "strategy" 



Average desired delay in ms to 
transfer a file of the size indicated. 

Number of such files expected to be 
downloaded per month 
Value to you in cents per file 
downloaded 

(Note: YoD can independently let your maximum 
niombly budget via the "Budget" screen, so the 
shape of this curve is more important than its 
maximum piice-point) 

Average size of file downloaded 

The web valuation attempts to translate a content hosting business need into bandwidth and 
price requirements. The formulas used are: (max bandwidth in Mips) - fsize * 8 / delay 

(Max price in S/month) = value ♦ (hits per /month) / 1 00 
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Valuation - Elastic Demand 

Selection screen for bidding "strategy** 

I This display provides the user a feci for 
y the shape of the curve. The right 
display is the price-point for the amount 
I of bandwidth to the left. 
L^Max bandwidth desired (see discussion, 

below, for impact of this setting) 
L — -Max price-point (see discussion, 
below, for impact of this setting) 

Note : YoD cui tndetiesdently set your ouximum niOfitUy 
btMlget vU (be "BudgBt" screca, CO the stupe of this curve 
L ivinwQimportuittlua its nuximuiD price-point 
Note 3: Yoo nay enter new vtlues by drsgging and 
diopfung the nd dot Oft the gnph wltii your cnnor 

**Elastic" valuation models how users have histoiically valued internet bandwidth. The 
formula, when used as a bid strategy (sec Bid Canvas), is: 
(Price per unit bamhwdtli) * (Qty of Bandwidth!? = (.0012) * (Mwprico-poiirt) ♦ (Max bandwidth)^ 
Note 3: Constant (,0012) is oorect for units shown, above. It wUl seal© depending oa units selected. 
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Valuation - Inelastic Demand 



Selection screen for bidding "strategy" 




\^No»c 2: You may eowr new vilucs by draKlnj and 
dropping tli» red dot on the graph with your cnrtor 



Note : Ycu can independently »et your maximtun manthly 
budget via the '^Buc^et** (cieen, so th« thape of thii curve 
is more inpoit&at than its maximum price-point 



This display provides the user a feel for the 
shape of tbc curve. The right display is the 
pricc^oint for the amount of bandwidth to 
the left 



Max bandwidth desired (see discussion, 
below, for impact of this setting) 



below, for impact of this setting) 



Max price-point (see discussion. 



**Inelastic** valuation indicates that you wish to pay the same price per unit 
bandwidth regardless of the amount of bandwidth received. This results in a 
horizontal bid strategy line on the Bid canvas, following the formula: 

(Price per unit bandwidth) » (Max price-point) / (Maximum Bandwidth Desired) 



When tixe elastic bid strategy is combined with the knowledge of the second 
price anction mechanism, it results in the following behavior 

If the elastic valuation is above the budget line, the agent will do a reverse 
calculation to determine when it can bid on the valuation line, but obtain the 
bandwidth on the budget line. 

If the elastic valuation is below the budget line, the agent will continue to ask 
for the m;*xiTttiirn amount of bandwidth at the valuation price and not accept a 
lesser amount of bandwidth. 
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"Strategy" Screen 

Display of bids being submitted in real time 



yBid" area «Bid" area gcttable time Display of bid fee 

indicates allows entry of between (Bid fee is an optional 
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"Allocation'' subscreen 

Results of previous bidding round 



If, as is oormal, the bidding round b terminated when no bids are 
received within a configured amount of time, the "Time Left" 
counter will count down from the configured time^ but get reset 
whenever a bid is received by the Resource Agent, fipom anyone. 
When this counter reaches zero, an allocation will be made and a 
new bidding round wiU begin after a slight pause to implement 
the allocation. 



Allocation 
(Quantity and 
Price per unit 
bandwidth) 
received during 
the last bid cycle 




Total amount 
spent during 
this session 
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"Allocation Graph" Subscreen 

Allocation history over time 

Allocation price (per unit bandwidth) 
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"Bid Canvas" Screen 

A dynamic display of the second price auction in progress 



Red circle is fhe bid 
you intcad^ tubmit. 



Solid Magenta dot is 
di« allocation yoQ 
received last tovnd 



Maseatacirclc Istbe 
allQcstioa you 
would get based on 
yoor last bid. 



Bhift shaded irea 
tepiecBatB bandwidth 
allocated, from right to 
left. If dtfiferent Mdden 
p&ydinciaitintiipilcct, . 
it wUl look like steps. 
B\B£k Bpaoe at left 
indicates that not all 
bandwidth WIS allocated 
based on the coneni bid*. 




Blue dots tr« Other bidden. Tfaeiiposjtion 
tcfxresents tbe quantity of bandwidth and the 
price per tmh bandwidth &ty offered 



Solid red dot it yoer lui 
bid. Red aumber next to 
dot is your bidder ID 
number . 




Magenta Use represcnu your budget. 
Agent, if autoiDatcd, wIU never bid 
above ttui line, regardlcsi of bid 
<vn)itetloii) fXTBUsy Une 



Red lino repicMaB 
'bidding <valu3tioD) 
itratcfy. Your bids, 
if antomited, will 
follow Ihii fine. 



Far right dot is aeller. 
Shows price floor and 
bandwidth beiag sold 



Note: Maaual bids may be placed by placiag yotir cursor at the positioD which repnicnis 
your bid and cluking your mouse. 



04/15/2004, EAST Version: 1.4.1 



Patent Application PubUcation May 29, 2003 Sheet 38 of 38 



US 2003/0101124 Al 



it. 



Bid Table'' Subscreen 



A dynamic display of the second price auction in progress 



ID'S of 
bidders 



Columns can be resized by 
dragging column separators 




"Rate" is allocated Quantity times 
bid Price (per unit bandwidth) 

Bidders shaded in blue would 
receive an allocation of bandwidth 
if no further bids were received 

You arc bidder with red text 



This is the "rate" bidder in red (you) 
would pay for the bandwidth allocated 
(as opposed to what you bid, above) 



Bidders with no shading would receive no 
allocation if all bids remained the same. 

Bidders shaded in yellow arc those used to 
calculate the auction price of bandwidth 
eived by the bidder shown in red (you) 

Bottom un-shadcd bidder is the seller. 
The seller's **bid" is his price floor 



04/15/2004, EAST Version: 1.4.1 



us 2003/0101124 Al 



1 



May 29, 2003 



METHOD AND SYSTEM FOR MARKET BASED 
RESOURCE ALLOCATION 

RELATED APPLICAnONS 

[0001] This application claims priority under 35 U.S.C. 
§119(e) to U.S. Provisional Application No. 60/203,849, 
filed May 12, 2000, which is herein incorporated by refer- 
enced in its entirety. 

BACKGROUND 
[0002] A. Technical Field 

[0003] T liis application relates to a system and mejj^gd for 
real- tjpie r esource allqcati2ji_and, s pecifically, to a jyatfiDj 
an d method for allowing real-time buyers and sellers to bi d 
for resources and controlling the appl icable resources in 
accordance wim me Dias. 

[0004] B, Background of the Inveation 

[0005] Over the past several years, the Internet has 
become an important mechanism for conducting business. It 
has helped reduce business cost and enabled the customized 
delivery of goods and services. To facilitate exchange of 
goods and services, electronic commerce technologies have 
been developed, ranging from simple Internet shopping sites 
to auction sites such as Yahoo (http://www.yahoo.com) and 
eBay (http://www.ebay.com). 

[0006] At the same time, a small but growing market for 
telecommunication network bandwidth has developed. 
Bandwidth, however, is unlike traditional commodities, 
goods and services, in that: 1) it is a shared resource that 
cannot be stored. As such, any bandwidth capacity unused 
by one party can be made available to all other parties 
having access to it or it is lost. 2) The resource of bandwidth 
is consumed in real time. That is, it can occur simultaneously 
with the buying of the resource. 3) Demand for bandwidth 
fluctuates very rapidly and tends to be elastic. 

[0007] Recently, the need for a dynamic bandwidth com- 
modity market has beeu recognized. Bandwidth exchanges 
have been developed between new network companies and 
Internet service providers. The old system of signing lengthy 
contracts after weeks or months of negotiation does not 
move fast enough for buying and selling of many Internet- 
related resources, such as bandwidth. 

[0008] The allocation of information service resources can 
be viewed as an exchange of commodities. In particular, in 
the case of bandwidth, Dow Jones has announced plans to 
laimch a bandwidth index that will provide price for long- 
haul data routes and will enable comparues to use these 
figures to peg the changing process for contracts when they 
are buying access to networks. 

[0009] The emerging telecommunications market call for 
new mechanisms for real-time trading of network resources, 
such as bandwidth. In a convention human-based resource 
trading system, resowces for sale are posted, such as on a 
bulletin board or similar online location. Human beings 
peruse the posted resources and try to decide which 
resources their organizations wdl need in the future. The 
humans then place bids against each other for the resources. 
Such human-based resource trading systems usually operate 
on large amounts of bandwidth at a time and trades are 
performed periodically, the period being fairly long due to 



the limits of human attention span and speed. For example, 
it would be impractical for a hxmian-base trading system to 
buy and sell resources in one minute or five minute parti- 
tions, since human beings are not capable of such speed. In 
addition, most human-based resource agents rely on addi- 
tional human interaction to implement the results of the 
resource bidding. 

SUMMARY OF EMBODIMENTS OF THE 
INVENTION 

[0010] The present invention provides a platform for 
resource 'allocation in real-time. One or more software 
resource agents interact with software player agents, which 
are usually both s and seller agents, to reach an agreement 
on price and quantity allocations for each buyer of that 
resource (for example, X Mbs of bandwidth for Y units of 
time, at price Z for buyer A). The s operate in accordance 
with one or more strategy rules for that agent. A strategy rule 
tells the what strategy to use in bidding against other agents 
for particular resources. The s also operate in accordance 
with valuation ruks ^ that tell the how to value a particu far 
resource when bia oing (this value is often used as a part o f 
t Se strategy nlle). ^teller ag ents also contain their own 
strateg y and valuat i on lules^^ w hich allow them to decid e 
how much of a resource to offer and bow to set a minimum 
pri^T or the resource . Bot k player agents (buyer and selle rs) 
resou rce agents are aware of a global allocation rul e 
u sed by m e resouirce agent to allocat e a resource between tu e 
b uyers. In m e buyer add Sfeller agents, this allocation rule is 
often considered in aetermimng siraiegy." 

[0011] I pjhe described emb ndi'ment, player agents (buy er 
a nd seller) also contaj yi a craph^'^^^ ^^^rr int erface that allow s 
human beings to set their rules and to control various as pects 
of the player agent . 

[0012] In general, the present invention promotes the 
sharing of a limited resource, such as bandwidth, buffer 
space, memory space, storage, or processor time, in a 
competitive environment. This environment ensures that 
whomever need the most resource and has the abihty to pay 
wUl get a share of the resource in accordance with willing- 
ness to pay, in addition, the invention adjusts for the chang- 
ing needs of the participants over time. 

[0013] Advantages of the invention will be set forth in part 
in the description which follows and in part will be apparent 
from the description or may be learned by practice of the 
invention. The objects and advantages of the invention will 
be realized and attained by means of the elements and 
combinations particularly pointed out in the appended 
claims and equivalents. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] FIG. 1 is a block diagram of an embodiment of the 
present invention. 

[0015] FIG. 2 is a flow chart of a method performed by a 
resource agent of FIG. 1. 

[0016] FIG. 3 is a flow chart of a method performed by a 
of FIG. 1, 

[0017] FIG. 4 is a flow chart of a method performed by a 
seller agent of FIG. 1. 
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[0018] FIG. 5 is a chart showing an example of the result 
of an allocation rule. 

[0019] FIGS. 6(fl) and 6(b) show an example of a valua- 
tion rule. 

[0020] FIGS. 7(a) and 7(b) show an example of a strategy 
rule. 

[0021] FIG. 8 shows an example of a flow chart used by 
an accounting system of an embodiment of the invention. 

[0022] FIG. 9(a) is a more detailed block diagram of the 
embodiment of FIG. 1. 

[0023] FIG. 9(b) shows an example of how a bandwidth 
resource is given to the winning bidder, 

[0024] FIG. 10 shows an example of an embodiment of 
the present invention including a "garage" for player agents. 

[0025] FIGS. n(a)-ll(b) are an example of an XML file 
for a generic player agent. 

[0026] FI GS. 12(a)-12(c) shown an example of Java code 
implementing a strategy rule for a. 

[0027] FIGS. 13(fl)-13(c) show an example of Java code 
implementing an allocation rule for a resource agent 104, 

[0028] FIG. 14 is an example of an XML file for a generic 
resource agent. 

[0029] FIGS. lS(a)-lS(r) show examples of user inter- 
faces for buyer and seller agents. 

DETAILED DESCRIPTION OF EMBODIMENTS 

[0030] Reference will now be made in detail to several 
embodiments of the present invention, examples of which 
are illustrated in the accompanying drawings. Wherever 
practicable, the same reference numbers will be used 
throughout the drawings to refer to the same or like parts. 

[0031] The present invention uses distributed, self-opti- 
mizing software agents to perform resource allocation more 
efficiently than centralized or human-based systems. 

[0032] FIG. 1 is a block diagram of an embodiment of the 
present invention. FIG. 1 includes a software pUyer agent 
102, which represents multiple and seller agents. A typical 
system will, include both buyer and seller agents 102. FIG. 
1 also includes a software resource agent 104, a software 
accounting agent 106, a network control and management 
agent 108 and a resource 110. It is contemplated that 
resource 110 can be a number of different resources, includ- 
ing but not limited to: bandwidth, buffer space, memory 
space, storage, or processor time. As shown in FIG. 1, each 
player agent (buyer and seller agent) can contain a Graphical 
User Interface (GUI) 122, one or more valuation rules 124, 
one or more strategy rules 126, and one or more allocation 
rules 128. The resource agent 104 also contains the same one 
or more allocation rules 128. 

[0033] s 102 place bids to the resource agent 104, which 
ultimately decides which of the player agents is awarded a 
portion of each resource for a predetermined amount of time. 

[0034] Resource agent 104 alsn cnntrnls re.«;nurcft 110. 
based oiTtbe rcsults_of the bidding, by se npTng an allocation 
c ommand to network control and management agent 108 . 
Thus, for example, if the resource is Internet bandwidth, if 



buyer A has won X Mbs of bandwidth for 5 minutes, 
resource agent 104 directs the network control and manage- 
ment agent 108 to give precedence to packets originating at 
buyer A for the next five minutes or to ensure that the agreed 
upon bandwidth requirements are met for buyer A's packets 
for the next five minutes. The mechanism used to commu- 
nicate the albcation command from resource agent 104 to 
agent 108 can be any appropriate mechanism. Id the 
example shown, the allocation command will include an 
identification of the winning buyer or buyers and an iden- 
tification of the amount of resource allocated and the time 
period for which it is allocated. Other appropriate formats 
can be used without departing from the spirit of the inven- 
tion. In some embodiments, agents 104 and 108 are separate 
agents (as shown in the figure). In other embodiments, their 
functions are merged into a single agent. Agents 104 and 108 
can be owned and/or controlled by the same entity or by 
different entities. For example the owner of resource 110 
could oulsoxu"ce the market-based allocation to a business 
partner operating resource agent 104, while keeping the 
network management and control function in its own hands, 
by retaining operation of the network control and manage- 
ment agent 108 themselves. 

[0035] In the embodiment shown, network control and 
management agent 108 controls resource 110 to implement 
the allocation command received from resource agent 104. 
Thus, agent 108 commits the resource allocated to a player 
after the resource agent 104 has closed the bidding. Network 
control and management agent 108 provides a common 
interface for resource agent 104 for all systems supported. Id 
certain embodiments, there is one agent 108 per resource. 
Alternately, a single agent can control multiple resources 
and communicate with multiple resource agents 104. In the 
embodiment shown, network management and control agent 
108 controls resources belonging to other entities (i.e., not to 
the owner of resource agent 104). In other embodiments, 
resource 110 might also be under the direct control of the 
owner of resource agent 104. 

[0036] FIG- 1 shows that network control and manage- 
ment agent 108 sends either Simple Network Management 
Protocol (SNMP) commands or COPS (Common Open 
Policy Service Protocol) commands to the resource. The 
SNMP protocol is well known and is described in RFC 1089, 
RFC 1270, RFC 1303, RFC 1298, RFC 1418, and RFC 
1419, which are incorporated herein by reference in their 
entirety. The COPS protocol is well known and is described 
in "The COPS (Common Open Policy Service," dated Mar. 
5, 1999, available from Adobe Systems, Inc. of San Jose, 
Calif., and RFC 2748,, both of which are incorporated herein 
by reference in their entirety. Other appropriate resource 
control protocols can be used without departing from the 
spirit of the invention. 

[0037] Once one or more wirming buyers are determined, 
resource agent 104 alerts accounting agent 106, which keeps 
track of the winning buyers, as described below in connec- 
tion with FIG. 9(a). Accounting agent 106 provides a 
common interface for all accoimting systems supported. 
Agent 106 preferably contains a database handler for each 
system it supports. Although accounting agent 106is shown 
as using one or more of the IHN and SQL database inter- 
faces, any appropriate interface to an accounting database 
could be used. 
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[0038] The 102 operates in accordance with one or more 
strategy rules for that agent. A strategy rule tells the what 
strategy to use in bidding against other agents for particular 
resources and, therefore constitutes a bidding mechanism for 
agents. 

[0039] The s flisn operate in accordance with valuati on 
ru les that tell the how to value a par ticular resource when 
"Bidaihg (this value is often used as a pari Of the"Strategy 
rule). Thus, a valuation rule typically tells an agent how to 
value each unit of a resource over a range of possible 
quantities, at a given time. Seller agents also conta in their 
own strategy and yjduatio n..Tul^,,^gicg'^ow theimr to 
de cide bow much.of.a resource to offer and how to dc ter- 
rni ne a minimum pjffe for the resp Tir ce. Strategy and va lu- 
at ion can depend on external information, such as ac coujit- 
iri g information and network congestion."" 

[0040] The valuation and strategy of player agents (buyer 
and sellers) and resource agents are aware of a global 
allocation rule used by the resource agent to allocate a 
resource between the buyers. In the buyer and seller agents, 
this allocatioD rule is often considered in determining valu- 
ation and/or strategy. Thus, an allocation rule typically can 
be thought of as corresponding to a market mechanism. 
Examples of allocat i on rules inclu de English auction s 
( familiar to perso'^wno' irequcnt numan-based antiq ue amd 
estate sale auctions^, Reverse Price A uctions (su ch as th e 
mai n eBay model), D ut^MBSn^and continuous bid-a sk 
t r'^ng. Ex amples of allocation rules are found, for example, 
in 1) jTf. Rosenschein and G. Zlotkin, "Rules of Encounter," 
MIT Press 1994; 2) PhD thesis of N. Semret, "Market 
Mechanisms for Networic Resource Sharing," Dept. of Elec- 
trical Engineering, Columbia University, submitted approxi- 
mately May 1999; and 3) H. R. Varian, "Economic Mecha- 
nism Design for Computerized Agents/* USENIX 
Workshop on Electronic Commerce, July 1995. Each of 
these three references is incorporated herein in its entirety. 

[ 00411 FIG, 2 is a flow chart of a method performed by 
resource agent 104 of ^IG. I. In at least certain embod i- 
ments, there is more than one resource agent^^ne fo reach 
f^urce. For example, if an ISP offers severaT^ijfferen t 
bandwidths, each bandwidth might be considered a separa te 
resource^ cootrolled by a separate resource agent 104 . 
Resource agents nref pTahJy nin jadthin-setysi5-tl3ajt.caji-fe e^ 
dgtributed over a net w ork. Al ternately, one or more resource 
managers 104 can reside on" the same system. 

[0042] As shown in FIG. 2, resource agent 104 receives 
202 one or more bids for resource 110 from one or more s 
102. Such bids wQl usually include at least quantity and 
price values. If a buyer is outbid, the resource agent notifies 
204 the buyer, unless the trading period is over 206. Once 
the trading period is over, the resource agent notifies 208 the 
winning or agents 4nd proceeds to send an allocation com- 
mand 210 to network control and management agent 108 
that will cause agent 108 to control the resource in accor- 
dance with the winning bids. 

[0043] FIG. 3 is a flow chart of a method performed by 
playerAJuyer 102 agent of FIG. 1. First, the is apprised of 
potendal resources available for bidding. This is accom- 
plished either by the player requesting current resource 
aucdon information from a centralized directory service (not 
shown) or by the player registering with the resource agent 
and periodically being sent information about current bid- 



ding. With a directory service, a player agent 102 queries the 
directory service to find the location (e.g., in the form of a 
URL) of resource agents 104, garages (see FIG. 10), and 
other player agents 102. The decides 302 whether to bid on 
a particular unit or resource 110 and sends 304 a bid to the 
resource agent. If the receives a notice that he has been 
outbid, control returns to element 302 and the agent decides 
whether to continue bidding. 

[0044] In element 302, the uses its knowledge of the 
system market allocation rule and of its own valuation rules 
to determine how much it is willing to pay for resources at 
a given time and uses its own strategy rules to determine 
whether to bid on available resources. If the includes a GUI, 
a human being can visualize the market using various known 
graphs, charts or similar graphics. A user can also use the 
GUI to change the strategy and valuation rules used by the 
agent. 

[0045] It should be noted that certain embodiments 
include a special type of player/, called a broker agent, 
which buys resources with the intent of reseUing those 
resources.. Thus, for example, a broker agent has no user for 
the resource (such as bandwidtii) itself, since the broker is 
not an ISP or similar entity in need of bandwidth. Instead . 
the brokcf^rranges for third party customers, suc h as ISPs . 
to receive the benefit of the resources the brolcer has bid f or 
a nd won, by reselling them through another resource ag ent 
inst ance, and the broker keeps the difference between th e 
biiymg and selling pricc^ In such a case, the new resource 
agent 1U4 miorms" the Network control and management 
agent 108 which party is to benefit from the resource bid for 
by the broker. FIG. 4 is a flow chart of a method performed 
by a player/seUer 102 agent of FIG. 1. A seDer agent first 
notifies 402 the resource agent that it has one or more units 
of a resource to sell (for example, 1 Mbs for 5 minutes or 10 
minutes of processor time). Once the bidding is over, seller 
agent 102 will receive fi-om resource agent 104 a notification 
404 of the winning bidder or bidders. In at least one 
embodiment, the seller agents collect the payments from the 
buyers based on accounting information retrieved from the 
accounting agent. 106. 

[0046] gIG. 5 is a chart showing an exanaple of the resu lt 
of a Progressive Second l*rice Auctiaa( PSP) al location rule . 
(TLher allocation nfle lypes^ 5Scu5sec!'alf6ve,'ca^also"5e 
used, d5 Speciti^d by the particular allocaaon market strat- 
egy implemented in a particillar systemTFIGrysK owirfiow 
resourced are allocated a nd prices set once" tKe'Hiddin gjs 
o yer and it is d6termjned"that tSere are not enou gh reso urces 
to satisfy all the bidders. ^ 

[0047] In the PSP auction of FIG. 5, bidder A bids $3 for ' 
50 resource units; bidder B bids $2 for 30 resource units; 
bidder C bids $1 for 30 resource units; and bidder D bids 
$0.50 for 20 resource units. At the close of bidding, resource 
agent 104 allocates the resources as follows: The 100 
available resource units are apportioned between the bidders 
until the resource is gone. Thus, the high bidder A is 
allocated all of the resource that he wants, as is the second 
high bidder B. Bidder C only gets 20 or the 30 resource units 
that he wanted and bidder D gets nothing, since there are no 
more resource units to allocate after partially fulfilling 
bidder C's wants. 

[0048] The resource agent 104 determines the amount that 
the bidders in the PSP auction are charged as foUows: For 
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each bidder, the resource agent determiDes the value of the 
bidder's resource if that bidder had not participated, and 
charges the bidder a price based on this determination. 

[0049] Thus, if bidder A had not participated, his 50 units 
would have been allocated as follows: 

[0050] 10 units to bidder C (to make up C's shortfall) 

[0051] 20 units to bidder D (to give D his requested 
number of units) 

[0052] The remaining 20 of bidder A's units would 
not have been allocated. 

[0053] The cost to bidder A is determined as follows: 

[0054] The cost of a resource unit to bidder C is 
$1/30. 

[0055] Thus, the value that would have been given to 
bidder C: 10x($l/30)-$0.33 

[0056] The cost of a resource unit to bidder D is 
$0.50/20. 

[0057] Thus, the value that would have been given to 
bidder D: 20x($0.50/20)=$0.50 

[0058] Thus, the cost of A's resources had A not partici- 
pated is $0.33+$0.50=$0.83. Bidder A is charged this 
amount for his 50 units of resource. 

[0059] Similarly, if bidder B were not present, his 30 units 
would have been allocated as follows: 

[0060] 10 units to bidder C (to make up C's shortfall) 

[0061] 20 units to bidder D (to give D his requested 
number of units) 

[0062] The cost to bidder B is determined as follows: 

[0063] The cost of a resource unit to bidder C is 
$1/30. 

[0064] Thus, the value that would have been given to 
bidder C: 10x($l/30)-S0.33 

[0065] The cost of a resource unit to bidder D is 
$0.50/20. 

[0066] Thtis, the value that would have been given to 
bidder D: 20x($0.50/20)-$0.50 

[0067] Thus, the cost of B's resources had B not partici- 
pated is $0.33+$0.50=$0.83. Bidder B is charged this 
amount for his 30 units of resource. 

[0068] Similarly, if bidder C were not present, his 20 units 
would have been allocated as follows: 

[0069] 20 units to bidder D (to give D his requested 
number of \mits) 

[0070] The cost to bidder C is determined as follows: 

[0071] Value that would have been given to bidder D: 
20x($0.50/20)o$0.50 

[0072] Thus, the cost of C's resources had C not partici- 
pated is $0.50. Bidder C is charged this amount for his 20 
units of resource. 

[0073] It should be noted that FIG. 5 shows only how 
resources are allocated after bidding is closed. An allocation 
rule also includes within it rules or explanations of bow the 



auction itself should be conducted. For example, a PSP 
auction generally lasts for a predetermined amount of time 
(for example, five minutes). While the bidding is open, 
resource agent 104 collects all bids received from the s 102 
and saves them in a bidUst data structure (e.g., a linked list). 
The bidlist data stmcture indicates which bid is the most 
recent bid for each 102. 

[0074] As bids are received from the s 102 by the resource 
agent 104, the resource agent 104 transmits the bids received 
to the other agents 102, so that all agents know what all other 
participating agents are bidding. Because each 102 has 
knowledge of the allocation method, each 102 can apply its 
strategy and valuation rules to determine whether that agent 
is going to be aUocaled the resources on which it has bid. 
The agent, applying the allocation, strategy, and valuation 
rules, determines whether it should bid again. In a PSP 
auction, bidding usually stabilizes after a few minutes. In 
some embodiments, resource agent 104 does not hold the 
auction open for a predetermined time, but instead waits a 
predetermined amount of time after the bidding has stabi- 
lized to make sure that no other bids are received. In some 
cases, resource agent 104 announces to the s 102 that 
bidding will close in a certain number of minutes or seconds. 
In some cases, if a bid is received during this time period, the 
auction is kept open a bit longer. 

[0075] Thus, an allocation mle (known to all agents) also 
includes information about how the auction will be con- 
ducted by resource agent 104, including, for example: how 
long an auction wiU last, if the auction has no set time 
period, what are the conditions for the auction to close. In 
addition^ as described above^ the allocation mle inclu3e s 
r ules describing how price_and quantities are assigned after 
the auction has closed. 

[0076] In a preferred embodiment of the invention, auc- 
tions last 5 minutes, although other periods of time could be 
used and these periods of time could be either variable or 
user-settable. In a preferred embodiment, the bandwidth 
resource being auctioned during a current auction is allo- 
cated immediately and another auction is begun immedi- 
ately. Thus, an auction occurs roughly every five minutes for 
the bandwidth that will be used by the buyers during the next 
five minutes. Other embodiments may not auction aQ band- 
width for immediate use. 

[0077] The PSP auction model is described further in A. A 
Lazar and N. Semret, "Design and Analysis of the Progres- 
sive Second Price Auction for Network Bandwidth Shar- 
ing," Telecommunications Systems, Special issue on Net- 
work Economics, which is attached hereto as Appendix A 
and forms a part of this application. 

[0078] Other examples of allocation rules include, but are 
not limited to a Hold Option Auctions, which are discussed, 
for example, in the PhD thesis of N. Semret, "Market 
Mechanisms for Network Resource Sharing," Dept. of Elec- 
trical Engineering, Columbia University, submitted approxi- 
mately May 1999, Chapter 4 of which (28 pages) is attached 
hereto as Appendix B and which forms a part of this 
specification. The Hold Option is a concept for advanc e 
price and quantity ^aranteed reservations of ne ^ork 
rR Rniirt^ff ^ i [\ a rftal-fime market environment. P eriodic auc- 
tions ( progressive second price^ or ^ther ) among arrivals 
grouped m batches give rise to the spot market of capacity 
changes. A reservation guaranteeing access for an arbitrary 
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duration with a capacity piece below the bid can be made at 
any time before or during service. This eliminates the risk 
(whidi is inherent on the spot market) of losing resources to 
higher bidders before service completion. The reservation is 
defined as a hold option, and is analogous to derivative 
financial instruments such as options and futures integrated 
over time. Based on a heavy traffic diffusion model, reser- 
vation fees can be computed as the fair market price of a 
hold optioiL Id at least one embodiment, special player 
agents 102 are allowed to place such hold options, thus 
providing a guaranteed reservation of a network resource for 
an arbitrary duration. 

[0079] FIGS. 6{a) and 6(b) show examples of valuation 
rules. In FIG. 6(a), a valuation rule is formed of pairs of 
quantity/price values. In FIG. 6(b), a valuation rule is 
formed as a fonction of various input variables. These input 
variables can include any or (but are not limited to): the 
number of hits on a web site the average file size down- 
loaded (and the bandwidth needed to service those files); the 
expected delay or expected latency, and the value of each hit. 
Valuation can also be time dependent (e.g., higher valuations 
are assigned during peak usage times when more bandwidth 
is needed) and the network state (e.g., more bandwidth is 
needed if the network is congested). 

[0080] It should be noted that there are engineering 
tradeoffs for the type of valuation rule used. Because a 
low- level valuation rule requires more inputs, which require 
more time and effort to coUect and receive, a low-level 
description may require a large amount of data to be 
transferred in order for the agent to be able to bid in 
accordance with the low-level valuation rule. On the other 
hand, a simple, high-level valuation rule reduces the ability 
of an agent to make an optimum bid because the agent is 
operating with less information. Either implementation can 
be correct for a given circumstance, depending on the needs 
of the particular player agent and the limitations of its 
system and network. 

[0081] FIGS. 7(a) and 1(b) shows examples of strategy 
rules, FIG. 7(a) shows a simple rule set, where the first 
precedent is to identify the type of allocation system being 
used. Once the allocation system if identified, the 102 
applies a set of predefined conventional rules to determine 
whether it should bid (or bid again), FIG. 7(b) shows an 
example where the strategy is based on a user-defined 
function. In the example, if the function reaches a threshold 
value, the agent 102 will bid (or bid again). Other examples 
of strategy rules decide not just whether the agent should 
bid, but how much the agent should bid, in accordance with 
the allocation rule being used by the system and in accor- 
dance with factors specific to that agent (such as, for 
example, those factors discussed above in relation to valu- 
ation rules). 

[0082] Certaia strategy rules are very simple and involve 
bidding constant amount. Such simple strategy mles may 
result in uneven amounts of bandwidth being won. Another 
example strategy rule is periodic bidding, in which a buyer 
agent enters auctions periodically. 

[0083] FIG. 8 shows an example of a flow chart used by 
an accounting system of an embodiment of the invention. 
The accounting system is notified whenever a resource agent 
closing bidding on a resource unit and keeps track 802 of the 
winning bids and resulting allocations. Periodically, the 



accounting system bills 804 the seller a percentage of the 
resources sold, which is received by the owner of the 
resource agent for operating the resource agent and account 
agents of the Merkato platform. 

[0084] FIG. 9(a) is a more detailed block diagram of the 
embodiment of FIG. 1. It will be understood that FIG. 9(a) 
details only one possible way to implement the present 
invention and that the description herein is not to be taken 
in a limiting way with regard to operating systems, proto- 
cols, programming languages, etc. The example shown is 
implemented in Java using the World Wide Web, but the 
invention is not limited to such a system. In fact, the 
invention can be implemented on any appropriate computers 
and networks, using any appropriate programming lan- 
guage, hardware, software, and operating system. Parts of 
the system can be implemented in software, firmware, or 
hardware, as needed. 

[0085] FIG. 9(a) includes four layers: an operating system 
(OS) layer 902, a Java layer 904, a Merkato layer 906, and 
a diffex layer 108. In the described embodiment, the OS 
layer 902 and the Java layer 904 are conventional and will 
not be described herein. Other embodiments may make 
changes to one or more of layers 902 and 904 to enhance the 
performance of the system, for example. In this example, the 
use of Java layer 904 makes the system platform indepen- 
dent. Thus, the Merkato layer 906 can run on any computer 
or computing device (such as a wireless device, pager, cell 
phone, or Internet appliance) 

[0086] Layer 906 allows a player agent 102 to be executed 
on the client side, from a Java application or an applet 
executing in a Web browser. Altemately (or in addition), a 
player agent 102 can be executed as a servlet on a web 
server, which is the "garage" environment of FIG. 10. 

[ 0087] Layer 908 enables real-time resource markets 
between peering ISPs. The layer allows ISPs to buy an d 
sell resources, su ch as bandwidth, from each other in re al- 
ti me. Layer 908 auctions in real-time the outgoing ban d- 
wi dth on each ISP's Une out of the exchange, ensuing th at 
at all times, the bandwidth goes to th e buyer withthe high est 
value for it. L ayer 90;^ also allows tor buying and selling in 
advance (i.e., making reservations with guaranteed_capacitv 
apd cap ped prices'^ throuRl La derivative market of optio ns, 
in effect enablin^ the trading of risk and hedg ing, for 
ori ^nal ISP buyers and se ller s, as well as for purely financia l 
players. 

[0088] FIG. 9(b) shows and example of how a winning 
buyer ISP 952 is given a resource, such as bandwidth. In 
FIG. 9(b), a seller ISP 956 has a seller 902 agent running on 
a diffex client. As discussed above, the seller agent deter- 
mines that the ISP has bandwidth to sell (e.g., through user 
input via the seller agent GUI) and makes that bandwidth 
available for auction by sending a message to resource agent 
904 (see numeral 1 in a circle). The buyer ISPs 952, 954 
have s 902 running on a diffex client. The s bid on the 
bandwidth in accordance with their allocation rules, strategy 
rules, and valuation rules, as discussed above (see numeral 
2 in a circle). For certain types of allocation models, the 
agents also receive information about bids during the auc- 
tion (not shown). Once the auction^ is concluded, resource 
a ^ent 904.scnds an allocatio n com mand t o network con trol 
and management agent 908 (numeral 3 in a circle), which in. 
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t uTD controls a router 970 of the seller ISP so that th e 
wianinp buyer ISP receivesit s handvyirith rsfiR-numeralAin 
a circle). 

[0089] Resource agent 104 in layer 908 interfaces with the 
resource (e.g., with the router 970 of the seller ISP) to 
allocate the bandwidth to the winning bidder. Specifically, 
resource agent 904 interfaces with control agent 908 to send 
commands to the router of the seller ISPs. If, for example, 
the resource is bandwidth, allocation to the winning bidder 
can be effected by one of the following or by any other 
appropriate method: 

[0090] a) the router 970 is given a set of class-based 
weighted-fair queuing parameters to be used by the 
router to control packet queuing in the router so that 
the winning ISP buyers are assured of receiving the 
bandwidth which they was allocated by the resource 
agent. These queuing parameters will give priority to 
the winning bidders when packets from the winning 
ISPs are sent to die seller ISP's router. 

[0091] b) the router is given a set of committed 
access-rate parameters to be used by the router to 
limit and shape trafiSc assure each buyer the band- 
width which it is allocated, or 

[0092] c) capacity within an MPLS (Multiprotocol 
Label Switching) tunnel between two points in the 
seller's network, 

[0093] Thus, as shown in FIG. 9(b), packets 960 from the 
winning buyer ISP(s) are routed through the seller's router 
and on to the seller ISP's network 956, &om which they are 
delivered to their destination. In at least one embodiment, 
the winning ISPs are aware that they have won and use 
existing routing protocols to ensure that they direct packet 
traffic to the seller ISP's router. In other embodiments, the 
resource agent informs routers in the winning ISPs of the 
needed routing change using known routing protocols. 

[0094] In the described embodiment, the resource agent is 
always executed on a Web server. Each resource agent 104 
runs as a servlet on a Web server. This architecture is 
scalable because resource agents 104 can be distributed to 
run on any Web servers supporting the concept of a servlet. 

[0095] In the described em bodiment. fnTr^miinicatinns 
betwceTa play er agent (either a buyer or a seller'^ 102 a nd 
a"resourc e agent 104 are performed via a resource agen t 
proxy usmg any ol http extensions, native TCP protocol, o r 
Java's remo te method invocation (rmi). All communications 
arc secu r e d t hrough an appropriate mechanism such as th e 
sccureg^socket l ayer (SSL^.^ A shown in FIG. 9(a), each 
agent (player and resource) has an allpcation rule object 128. 
The player agents 102 also have valuation rule objects 124, 
strategy rule objects, 126, and a GUI object 122. In addition, 
the resource agents 104 have networking and accounting 
drivers for interfacing with external support systems. Fufc 
ther security is provided through the implementation o f 
specific allocat ion rules that protect the stability otlbe 
s ystem. Sp eci hcallYj each user is required to bay a bid fee to 
rr^nurcTft agrnt 1fl4 f ^f every bid sent The implementatio n 
of aJiiA-fsfl is int rnded to prevent users from trying to 



artifidatly destabilize the resource, price aod to prevent a 
" man in the middle" attack, which is defined as a third part y 
intercepting a bid firom another age nt and ke eping sendin g 
t he same bid over aod over. In addition, timestamps^ are 
preferably used to discriminate every bid. Thus, if a bid has 
a previously used timestamp, resource agent 104 will ignore 
that bid. 

[0096] In the described embodiment, communication 
between agents is effected using http, thus bypassing many 
problems associated with firewalls, proxies, and other 
middleware. 

[0097] FIG. 10 shows an example- of an embodiment^ f 
the present invention inchiding a "garage'' lor player agen ts 
102'. The garage 130 is a component op a web server tha t 
serves the purpose of storing agents and enabling tfiei r 
execution remotely from a user's computer. The gara ge 
contains an "attendant" program 131 whose job is to help 
'm obile agents find a parking place in the garage and t o 
ensure proper agent ex ecution when the agents want to ru n 
autonomously . Ciarage 13U performs the function of a di s- 
t ribute d d atabase t o store the agents 10 2* and provides a 
d jtnbufed processor (not shown) to execute the agen ts. 
Garage 130 can be located on the same system as resour ce 
a gent 104, but can also be located on a different machine . 

[0098] The attendant is an example of a multi-agent. Multi 
agents coordinate multiple sunple agents to act together. 
Multi-agents can be used to form coalitions of agents, using 
the attendant to bid for aggregated resources on behalf of the 
coalition. In the described embodiment, the agents commu- 
nicate with the attendant to let the attendant know that they 
need resources. The multi-agent aggregates the various 
types of resources requested (e.g., different connection 
speeds or different bandwidths) and uses the allocation rule 
and its own strategy and valuation rules to bid on behalf of 
the agents. If the multi- agent wins, the resource is divided 
between the agents and the attendant so informs the resource 
agent 104, which allocates the bandwidth accordingly. A 
broker is an example of a multiagent, coordinating buyer and 
seller agents for a common objective to act as a profit- 
maximizing reseller. 

[0099] In the described embodiment, agent mobility to the 
garage is provided through XML. The syntax and semantics 
of an agent is described using XML. For example, the 
semantics of an agent can include its allocation, strategy and 
valuation rules. Each agent can be transferred to the 
"garage"130 by generating its XML description. Once an 
agent is provided in this form, it can be re-instantiated either 
in a garage 130 or in a user's computer in an applet or a java 
application. 

[0100] FIGS. ll(fl)-ll(fc) are an example of an XML file 
for a generic player agent 102. This XML would be used, for 
example, to send the agent 102 to a client for execution in 
garage 930. Each of the XML tags (indicated by < > 
brackets) identifies an attribute of the agent that is to be 
activated in the garage. It will be imderstood that the XML 
of FIG. 11 is shown for purposes of example only and that 
other embodiments of the invention may use more or fewer 
tags and/or different tags than those shown in FIG. 11. 
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[0101] FIGS. 12(fl)-12(c) shows an example of Java code 
implementing a strategy rule for a 102. This example 
implements a strategy in accordance with the PSP auction 
model described above. As shown in section 1234 of FIG. 
12(c), an agent using this strategy will submit a new bid only 
if the new bid determined in the rule is increased by at least 
a calculated value epsilon. Note that this strategy rule calls 
a valuation rule in line 1232 of FIG. 12(c). This valuation 
rule implements a PSP valuation method. 

[0102] FIGS. 13(a)-13(c) show an example of Java code 
implementing an allocation rule for a resource agent 104. 
This example looks at a number of received bids in a bidlist 
data stmcture and computes an allocation (similar to that of 
FIG. 5) given the current bids on the bid list in accordance 
with a PSP auction allocation model. 

[0103] FIG. 14 is an example of an XML file for a generic 
resource agent 104. This XML would be used, for example, 
to send the resource agent 104 to a web server. Each of the 
XML tags (indicated by <> brackets) identifies an attribute 
of the agent that is to be activated on the server side. 



[0104] FIGS. 15(fl)-15(r) show examples of user inter- 
faces for buyer and seller agents. FIGS. 15(a) and 15(6) 
show an example of an html GUIs that provides static 
information to a user. FIGS. 15(c) and 15(d) show an 
example of GUIs implemented as a Java applet. The infor- 
mation provided by these interfaces is continuously updated 
in real-time or periodically. FIGS. 15{e)-15(r) show an 
example of an advanced GUI, which is preferably also 
implemented as an agent. Particular buyer and seller agents 
may have one, none, or all of the particular GUIs shown 
here, or may have GUIs providing other relevant informa- 
tion not shown here. Note that several of these GUIs aUow 
a human user to choose the valuation and/or strategy rules 
and to determine when and how to bid. It should be 
understood that in the preferred embodiment, buyer agents 
are capable of bidding on their own. Other embodiments 
may contain agents that bid only at the direction human 
beings. 

[0105] Accordingly, the present invention is intended to 
embrace all such altematives, modifications and variations 
as fall within the spirit and scope of the appended claims and 
equivalents. 
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Abstract 

We present the Progressive Second Price auction, & new decen- 
tralized mechanism for allocation of variable-size shares of a resource 
among multiple users. Unlike most mechanisms in the economics lit- 
terature, PSP is designed with a very small message space, making 
ii suitable for real-time market pricing of communication bandwidth. 
Under elastic demand, the PSP auction is inceative compatible and 
stable, in that it has a "truthful" c-l>fasb equilibiium where all players 
bid at prices equal to their marginal valuation of the resource. PSP 
is economically efficient in that the equiHbrium allocation maximises 
total user value. With simulations using a protype implementation 
of the auction game on the Internet, we investigate how convergence 
times scale with the number of bidders, as well as the trade-off between 
engineering and economic eiSciency. We also provide a rate-distortion 

*Fari5 of this vroik were presented at the 8'^ Intcmaiionai Symposium on Dynamic 
Games and Appiicatiom, Maastricht, Tbe Netherlands. July 1998, and at the DfMACS 
Workshop on Economics^ Game Theory^ and the Jntemet, Rutgers, NJ, April ISST. 

* Corresponding author. 
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theoretic basis for valuatioa of bandwidth, which leads naturally to the 
elastic demand model that is assumed in the analysis of the mechanism. 

Keywords: resource allocation, auctions, game theory, mechanism 
design, network pricing. 

1 Introduction 

Cominmication netwoiks are characterized by what economists call exter- 
nalities. The value a user gets &om the network depends on the other 
users. The positive externalities are that a commimication network is more 
valuable if more people are coimected. The negative externalities are that 
resources are shared by users who — because of distance, population size, or 
sel£slmess - cannot or wHI not coordinate their actions sufficiently to achieve 
the most desirable allocation of resources. The recognition of this reality in 
many aspects of networks and distributed computations has lead in recent 
years to the emergence of game theoretic approaches in their analysis and 
design [23, 9, 25, 33, 15, 16]. 

Prices, whether they relate to '^eal money" in a public network or '*funny 
money^ (based on quotas) in a private system, play a key role as allocation 
control signals. In the former case, this role is of course intimately tied to 
another, which is to allow a network provider to remain- in l>nsiness [7}. 

The telephone system and the cnrrent Internet represent two extremes 
of the relationship between resource allocation and pricing. The resources 
allocated to a telephone call are fixed, and usage prices are based on the 
predictability of the total demand at any given time. On the Internet, the 
current practice of pricing by the maximum capacity of the user's connection 
(Saturate pricing) decouples the allocation (actual use) of resources from the 
prices. 

In the emerging multiservice networks (ATM, Next- Generation Inter* 
net), neither of these approaches are viable. The former because of the Avide 
and rapidly evolving range of applications (including some which adapt to 
resource availability) will make demand more difiicnlt to predict. And the 
latter because, once the flat fee is paid, there are no incentives to limit usage 
since increasing consumption benefits the user individually, whereas limiting 
it to sustainable levels brings benefits which are shared by all. This makes 
it vulnerable to the well-known ^tragedy of the conmions". With flat pric- 
ing alone, the tendency is toward increasing congestion which chases away 
high-value users, or increasing prices which exclude low-value users (6), in 
both cases leading to decreased network revenue. 
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Thus there is a need to develop new approaches to piidng of network 
resources. Among the requirements are: sensitivity to the range of resource 
requirements (either through a sufficiently rich range of traffic closes which 
are priced difiTerently, or by aflowing users to explicitly quantify resource 
requirements); prices must be dynamically responsive to unpredictable de- 
mand (market based system); perhaps most importantly the piidng archi- 
tecture should constrain as little as possible the efficiency trade-offs of the 
policies. 

Indeed, the fundamental issue in designing pridng polides is the trade- 
oif between engineering effidency and economic effideacy. This trade-off, 
which is more or less constrained by the underlying network technology, has 
many dimensions, induding: 

• bow much measurement (from usage to capadty pridng), 

• the granularity of diiferently priced service offerings (e.g. rnunber of 
traffic classes), 

« the level of resource aggregation - both in time and in space - at which 
pridng is done (per packet/cell or per connection, at the edge of the 
network or at each hop), and 

• the information requirement (how much a pncri knowledge of user 
behavior and preferences is required/assumed by the network in com- 
puting prices). 

An approach whidi achieves economic effidency is the smart-market ap- 
proach of [19], wherdn each packet contains a bid, and if it is served, pays 
a dearing price given by the highest bid among packets whidi are denied 
service (dropped). This approach is incentive compatible in that the optimal 
strategy for a (selfish) user is to set the bid price in each packet eqnal to 
the true valuation. Each node in the network becomes an effident market, 
but the engineering cost (sorting packets by bid price, as well as per-packet 
and per-hop accounting) could be significant if line speeds are high relative 
to the processing power in the router. In [14], users are charged according 
to a combination of dedared and measured characteristics of traffic- By 
taking an equivalent bandwidth model of resource utiHzation, and assuming 
appropriate traffic models, a menu of pricing plans indexed by the dedared 
traffic can be offered which encourages users to make truthful dedarations 
(e.g. of the mean rate), and also encourages the users' characterization ef- 
forts to be directed where they are most relevant to the network resource 
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aUocation. As the pridng is relative, (14] does not aim to address the prob- 
lem of detennioiiig the actual monetary values of the market price (that 
users would be willing to pay). Another pricing scheme which incorpo- 
rates multiplexing gain is formulated in [12]* These and a number of other 
schemes are summarized in (11], in a comprehensive view of the connection 
establishment process, which identifies the user-network negotiation as the 
key "missing Ikk'* in network engineering/economic research. In terms of 
our taxonomy of the previous paragraph^ this is part of the information re* 
qoirement trade-off!. Indeed^in the absence of formal mechaniams to deal 
with the mformation problem, complex and (at least intuitively) undesirable 
things happen. For example, some providers offer expensive %om of the 
book" rates to uninformed customers, and lower ''back of the book** rates to 
informed customers who may be about to defect to another carrier (see [7] 
and also the recent wars between AT&T and MCI in consumer long-d^tance 
service in the United States). In [34], it is argued that architectural consid- 
erations such as where charges are assessed should take precedence over the 
pursuit of optimal efficiency^ and edge pricing (spatial aggregation in terms 
of our taxonomy) is proposed as a useful paradigm. 

In this paper, we propose anew auction mechanism which accommodates 
various dimensions of the engineerxng-economics trade-off. The mechanism 
applies to a generic arbitrarily divisible and additive resource model (which 
may be eqoi^'alent bandwidth, peak rate, contract legions, etc, at any level 
of aggregation.) It does not assume any specific mapping of resource allo- 
cation to quality of service. Rather, users axe defined as having aji explicit 
monetary valuation of quantities of resource, which the network doesn't or 
can't know a priori. Thus, in terms of our trade-off taxonomy, this mech- 
anism aims for unlimited granularity, flexibility in the level of aggregation 
and minimal information requirement. 

In the most likely auction scenaria, users would be aggregates of many 
flows data flows for which bulk capacity is being purchased for e.g. Virtual 
Paths, Virtual Private Networks, or edge capacity {2, 31). 

We b^n in Section 2 by formaUy presenting the design of our Progres- 
sive Second Price auction mechanism for sharing a single arbitrarily divisible 
resource, and relating it to classical mechanism design from the economics 
litterature. In Section 3, after describing our model of user preferences 
and the elastic demand assumption, we prove that PSP has the desired 
properties of incentive compatibility, stability, and efficiency. The section 
concludes with simulation results on the convergence properties, and the 
efficiency trade-offs. Appendix A describes an information theoretic baas 
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for valuations of the type tlat are assumed in the analysis of Sections 3, as 
one possible justification. 

2 Design of an Auction for a Divisible Resource 
2,1 Message Process 

Following (36], it k useful to expose the design in terms of its two aspects: 
realization, where a message process that enables a certain allocation ob- 
jective is defined; and Nash implementation, where allocation rules are de- 
signed with incentives which drive the players to an equilibrium where the 
(desjgner^s) desired allocation is achieved. 

In this section we deiine the message process. Here we make tbe ftin- 
damental choice which will constrain the subsequent aspects of the design. 
Our first concern here is with engineering. Fbr the saJcc of scalability in a 
network setting, we shall aim for a process where a) the exchanged messages 
are as small as possible, whOe still conveying enough information to aUow 
resoujce allocation and pridng-to be performed without any a-priori knowl- 
edge of demand (market research, etc.); and b) the amount of computation 
at the center is zoinimized. 

Given a quantity Q of a resource, and a set of players X = {I,. . .,/}, 
an auction is a mechanism consistiiig of: 1) players submitting bids, i.e. 
declaring their desired share of the total resource and a price they are willing 
to pay for it, and 2) the auctioneer allocating shares of the resource to the 
players based on their bids. 

Flayer Ts bid is 9i - (g,-,p,-) 6 Si = [0, Q] X [0, oo), meaning he would like 
a quantity m at a unit price p,*. A bid profile is s = (^i, . . * • s/). Following 
standard game theoretic notation, let 5.,* H (^i,.. M^i-li^'-fii •* J-^- 
the bid profile of player Ts opponents, obtained from a by deleting a,-. When 
we wish to emphashe a dependence on a particular player's bid jj, we will 
write the profile a as (s,-; 

The allocation is done by an allocation rule A, 

Al S — S 

^ = iq.p) ^ AW = K5),c(s)), 

where J = Tli^jS{. 

The i-lh row of A(^), Ai(s) = (0,(5), c,(j)), is the allocation to player 
i: she gets a quantity a{{j) for which she is charged Ci(s), Note that p is a 
price per unit and c is a total cost. 
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An allocaticm rule A is feasible if Vf, 

and Vt € I J 

Otis) < qu 

Remark a: The above fommlatioai is a generalization of what 12 usually 
meant by an auctioa. The latter is the special case where aj/) = Q for 
some winner ti? G T and c;(5) = 0, Vt ^ i.e. tie sale of a single indivisible 
object to one buyer, for which the theory is well developed [22, 24]. In our 
approach, allocations are for arbitrary shares of the total available quantity 
of resource. Equivalently, one could slice the resource into many small units, 
each of which is auctioned as an indivisible object. But in a practical imple- 
mentation of auctions for sharing a resource, a process of bidding for each 
individual unit would result in a tremendous signaling overhead. More im- 
portantly, since the users would be bidding on a discrete grid of quantities, 
analytical predictions of outcomes could be misleading since they could be 
sensitive to the particular choice of grid^. 

Remark b: Most of the mechanism design literature in Economics 
makes use of the following "Revelation Principle'': 

Given any feasible auction mechanism, there exists an equivalent* 
feasible direct revelation mechanism which gives to the seller and 
all bidders the same expected utilities as the ^ven mechanism. 
f[24], Lemma 1) 

In this sharing context, a direct revelation mechanism would be one where 
each user message consists of the user's type, which is the valuation^ of the 
resource over the whole range of their possible demands, i.e. a function 
Q. : [o,Q] — (OyOo), and the budget (see Section 3.1). A consequence of 
revelation principle is that the mechanism designer can restrict her atten- 
tion to direct revelation mechanisms, find the best mechanism in terms of 

^For a more detailed discussion of this point, sec l4] p. 34, and icicTcnces therdii. 

^By equivalent, in [24] It is meant that, at some equiLbriuin, all players get the same 
nUUty. There may be othex, possibly iU*behaved, equilibria. 

^The vahatton of agiyen amount of resource is how much the nser is willing to pay for 
that quantity. The inverse of the valuation is the user's deuiand function, giving a defied 
quantity for each price. 
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her (economic) efficiency objectives, and then - if Becessary - transform it 
into aa equivalent mechanism in the desiied message space* This is conve- 
nient because one can exclude the infinitely many mechanisms with larger 
message spaces, without fear of missing any better designs. The design pro- 
cess is usually the solution of an optimization (mathematical programming) 
problem* For this reason, In the litterature, mechanism design problems are 
mostly solved for cases where the space of users' types is one dimensional^ 
or at most finite dimensional [21], using mess^e spaces that are of the same 
dimension. 

In our sharing problem, the conventional approach is unsatisfactory in 
two ways: 

• First, a user's type is infinite-dimensional, as we do not restrict the 
valuation fanctions beyond some very general assumptions (see Sec- 
tion 3.1), and so the conventional "programming" approach of de- 
riving the mechanism from the revelation pxindple would lead to an 
intractable problem. 

• Second, the conventional (direct revelation) approach, even if it was 
tractable, Implies that a single message (bid) can theoretically be in- 
finitely long, because it has to contain a description of the function Bi, 
Qearly, this is not desirable in a communication network, where sig- 
nalmg load is a k^y consideration- For engineering reasons, we choose 
a message space that is 2-dimensionai. Therefore, a given message can 
come from many possible types, so there is no single way to do the 
transformation from the direct revelation mechanism to the deaired 
one. 

Thus, unb'ke most of the mechanism design literature, we will take a di- 
rect approach, where we posit an allocation rule for our desired message 
space, and then show that it has an equilibrium, and that the design objec- 
tive is met at equilibrium^. .This is equivalent to guessing the right direct- 
revelation-to-desired-mechanism transformation and building it into the al- 
location rule from the start. 

^Oax aim is to to show that ve can use this smaller messaige space and still achieve our 
objective. 



04/15/2004, EAST Version: 1.4.1 



us 2003/0101124 Al 



16 



May 29, 2003 




Figure 1: Exdusion-compensation principle: the iBtuition behind the PSP 
rule 



2.2 Allocation Rule 
Define, for y > 0 

C.(y,5.,) = 



(1) 



and 



The "progressive second price" (PSP) aJlocatioii rule is deimed as follows; 



Qi{v, s^i) = Inn O .(77, = 



= 5I«[ttj(0;a.^)- ajU-;3.i)], (3) 

where A means taking the minimum. 

Remark a: For a fixed opponent profile 5.,. represents the 

maximum available quantity at a bid price of p,. The intuition behind 
PSP is an exclusion-compensation principle: player t pays for his allocation 
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so as to exactly cover the "social opportimity cost" which is given by the de- 
clared willingness to pay (bids) of the users who are excluded by t^s presence 
(see Figure 1), and thus also compensates the seller for the maximum lost 
potential revenue. Note that this amounts to implicitly assuming that the 
bid price accurately reflects the raarginal valuation 0^ on the range (a,-, qi]. 
In other words, by this rule the auctioneer is saying to the player: "if you 
bid (jtsPtOj I *ake it to mean that in the vicinity of ^i, tf,- can be approxi- 
mated by a line of slope p,." This is the (built-in) transformation from the 
direct-revelation mechaoism to the desired message process discussed in the 
second remarlc at the end of Section 2.1. 

The charge c,- increases with a,* in a manner similar to the Income tax in 
a progressive tax system. For a fixed opponent profile imagine player i 
is increasing g,*, starting from 0. The first few units that player t gets will be 
taken away fiom the lowest clearing opponent (i.e. m = argminj{pj : aj > 
0}), and player t will pay a price (marginal cost) Pm P^ ^t. '^^en Om 
loaches 0, the subsequent units that player i gets will cost him pm' > Pm^ 
where rnf is the new lowest dealing player^ the one just above m. The 
PSP rule is the natural generalization of second-price auctions (or Vickrey 
auctions). In a Vickrey auction of a single non*divisible object, each player 
submits a sealed bid. and the object is sold to the highest bidder at the bid 
price of the second highest bidder , which is what happens here if qi Q>Vt. 
This is widely known to have many desirable properties [35, 24, 4], the most 
important of which is that it has an eqxulibrium profile where all players bid 
their true valuation. As we will presently show, this property is preserved 
by the PSP rule jn the more general case of sharing an arbitrarily divisible 
resource, and this leads to stability (Nash equilibrium). The PSP rule is 
an^alogous to Clarke- Groves mechanisms [3, 8, 20] in the direct-revelation 
case. 

Remark b: When two players bid at exactly the same price, and they 
are asking for more than is available at that price, (2) punishes both of them. 
For example, if Q = 100 and si =: (4,60) and 52 = (4, 70), the allocations 
would be ci = 60 A ( 100 - 70) = 30, and a2 = 70 A (100 - 60) = 40. Since 
the bid prices are equals there is no ^^right^ way to decide who to give the 
remaining capacity to. One could divide it equally, or proportionally to their 
requests, etc. For the subsequent analysis, it turns out it is simpler to not 
give it to either one (of course, it wHl be allocated to the lower bidders if 
there are any). This is just a technicality since by deciding this, we ensure 
that it will never happen (at equilibrium), since the users will always prefer 
to change their prices and/or reduce their quantity. 
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Consaderiag the camputational complexity of PSPj a straightforwanl im- 
plementation wonld at worst, sort the bids in time /log/, perform (2) in 
linear time, and (3) can be done in time P. Thns, the complexity of com- 
puting tie allocations is 0{P). 

3 Analysis of the Progressive Second Price Auc- 
tion 

3.1 User Preferences 

Since tke allocation rule A is given by design, the only analytical assump- 
tions we make Is on the form of the players' preferences. 
Flayer t 's preferences axe given by his utility function 

Uii S — ^ (—00,00) 
s 1—* l^(s). 

Player i has a valuation of the resource 9i(ai(s)} > 0, which is the total 
value to her of her allocation. Thus, for a bid pro^e of Sy under allocation 
rule Ay player 1 getting an allocation Ai{s) has the quasi-linear utility 

tt,(*) = tfi(ai(«))-c<^) (4) 

which is simply the value of what she gets minus the cost. 

In addition, the player can be constrained by a budget bi € [0, 00]. so 
the bid Si must lie in the set 

SiM - {^i € Si : Ci[si; s^i) < bi}, (5) 

In the proofs of the following section, we will assume that users have 
elastic demand, that is: 

Assumption I for any i € Tj 

• Bi(Q) = 0. 

• 9i is difff-ifniiabltf 

• tf^ > 0, nofi'increasing and continuous 

. 37; > 0. y.- > 0, ei(x) > 0 => V17 < ^, < fl<(Tj) - 7i{z - 7,). 
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The last item says that as long as the vaJuation is strictly iacreasing, it must 
also be strictly concave (with miT^imnTn curvature 7,). Zowever, it is allowed 
to *^atten" beyond a certain amount of resource 

Fimctioiis of this (concave) form have wide applicability as models of 
resource valuation, and can be justified irom the economic standpoint (di- 
miaishlng returns) as well as from information theoretic standpoint * see 
Appendix A. For examples of valuations satisfying Assumption 1, see Sec- 
tion 3.4 and Appendix A. 

3.2 Equilibrimn of PSP 

The auction game is given by (Q, «i, , . . ♦ u/, A), that is, by specifying the 
resource, the players, and a feasible allocation rule* We analyze it as a 
strategic game of complete information [4]. 

Define the set of best replies to aprofUe s^i of opponents bids: S^{s^i) = 
{si € Si(s^i) :ui{si;3,i) > u,(5{;.j-,*).V6{ € Let5*(s) = UiSK^^il 

A Nash equilibrium itf a iixed point of the point*to-set mapping S*^ i.e. a 
profile 3 € S*(s). In other words, it is a point from which no player will 
want to unilaterally deviate. Such a point is what is most accepted as a 
consistent prediction of the actual outcome of a game, and has b«en re- 
peatedly confirmed by experiments, as well as a wide range of tlieoretical 
approaches. Indeed, in a d3^amic game, where players recompute the best 
response to the cunent strategy profile of their opponents, this iteration 
can only converge to a Nash equilibrium (if it converges at all). In addition, 
an important trend in modern game theory is the development of learning 
models, and there too, it has been shown that Nash equilibria result also 
from rational learning through repeated play among the same players [13]. 

A more general (and hence weaker) notion of stability is the existence 
of an f-Nash equilibrium. Let the «-best replies be Sf(s^i) = {s{ € Si{s^{) : 
Ui(si;s^i) > Ui(Si:s^i) — €,V^J € 5,(3-,)}. An €-Nash equilibrium is a fixed 
point of 5*. 

In a dynamic auction game, e > 0 can be interpreted ^ a, bid fee paid 
by 3 bidder each time they submit a bid. Thus, the user will send a best 
reply bid as long as it improves her current utility by c, and the game can 
only end at an e-Xash equilibrium. 

Define 

Pi(z, s.i) = inf (y > 0 : Qi{y, s.,) > r} . (6) 
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Thus, for fixed 5^*, Vy, z > 0, 

z<Qiiy,s^i)=>y>Fi{z,s^i) (7) 

^ y > Pi{z,3^i) =>x< Qi(y,s^i). (8) 

The graph of Pi(,,s^i} is the **staircase" shown in Figure 1, and that of 

is obtained by flipping it 90 degrees. 
It is readily apparent that 

r^''i>.(z,j?-.)d7. (9) 
Jo 

The key property of PSP is that, for a given opponent profile, a player 
cannot do much better than simply tell the truth, which in this setting means 
bidding at a price equal to the marginal valuation, i.e. set pi = ^(gi). By 
doing so, she can always get within c> 0 of the best utility. 

Let Ti = {si e Si : p{ = ^K«)}» (unconstrained) set of player i's 
truthful bids, and T = III ^ • 

Proposition 1 ^centive compatibility^ Under Assumpticn J, Vi € I, 
V^^ € S^i, such that Qi(OyS^i) = 0, for any € > 0, there exists a truthful 
i^best reply € 75 fl 5/(5.0. 

In particular, let 

Gii^^i) = |z € [0,C] : z < Q,-(^(z),3-f) end Pi(rj,s^i)dri < 6^} . 
Then with iv = [sup G;(5_f ) - e/^(0)]"*^ and w{ = «J(V|), t; = (u;,UJ,) € 

The truthful best reply can be found in a straightforward manner, as 
illustrated in Figure 2. 

Proof: Fix s^i € S^i. Let Zi = sup Gi{s^i) and y, =^<(r£). 

By definition of -z,-, 3{z(n)} C C?i(*-i) such tbat linin r(n) = Zi^ Hence 6,- > 
lintt„/^^"Vj(7?.s.i)rfi7 = So'Pi{v,^'i)dil > c,(t,;s.i), where the equality comes 
from the boundedness of Pi and the Lebesgue dominated convergence theorem, and 
the second inequality from (9) and (2). Thus € TnSi(s^i). 

^Actually, since Qt(.,s.i) is upper-senU'^antiiiuous (jumps up), vre have 2 < 
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Figure 2: Truthful <^best reply 



Next we show that U 6 S^(s^i). Fiist, Zi = linin j(n) < limn Qi(ffiU{n)), s-;) < 
Qi(Iiiiirt tf{(-r(n)), s.,), where the inequaJities follow respectively feom € Gi{5^i), 
and the upper senii-contiauity of Nowby thecontittuityof 5}, Qj(l]inn ^iWn))>*-0 = 

Q/(fl{(r,),s^O =£ <?f(«f,5-,-), hence 



Now, we claim that o,-(t,-; s.,-) = v,-. Indeed^ if r,- = 0 then tr,* = 0 and ai{U\ ^-0 = 0* 
If z< > 0, then by (10), Qi(i«,5.t) > 0 and since by hypothesis Q«(0,£-j) = 0, we 
have 9l{zi) = > 0. Also, j; > 0 implies Vi < Zi. Therefore, by Assumption 1, 
we have W{ = > ^f(^i) = jft. Hence, since is non-decreasing, 

q,{'Wi,s^i) > lim,\y = <?i(yM s.,) > z,- > v,. Thus, by (2), 



(10) 



(11) 



Now V^,- € 5.(*-,). 
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where the iBequality follows torn {zi — vi) < f/^-^O) and the fact that d{ is nonr 
increasing. Thus, it suffices to 6how that the integral is > 0. 

If iff < ai(«), take any ? € {JHt By the definition of i,-, z ^ Gi{s^i). Now 

Si e Si{s^i) implies 6* > Ci{s) = J^'^'^ Pi[Tj,^i^i)dj) > Therefore, 
we roust have x > whiA by (8), implies ^(z) < Pi(z) and the integrand 

in (12) is > 0 as desired. 

Suppose zj > a,'(si). Since 91 is non-increasing, « non-decreasing and 

> 0, any point to the left of z,- is in the act G^{J-<), \t<Zi^z^ Ci{s^\ 
hence z < Oi(^(z),«-<) which by (7), implies ^(r) > Pi{z,t^i), so the integrand 
in (12) is < 0 as desired. O 

Figure 3 shows the utiKty function of player 4, 114(^4), in a PSP auction, 
with / = 5 players, with 5-4 fixed, and a valuation ^^(g) = 10^. The plateaus 



conespond to the points where ^4 > Q^ijp^^s) = [Q — Eo*vy>w} 



and 04(5) can no longer be increased at that bid price - see (2). At bid prices 
Pa > PSf 't^c utility decreases when 04 > Q — 95, because after that point, 
each additional unit of resource is taken away from player 5, and thus costs 
ps, which is more than ^ its value to player u Thus, each additional unit 
starts bringing negative utility. This is what discourages users from bidding 
above their valuation. Proposition 1 is illustrated by the fact that for any 
given quantity Qa- the utility U4 is maximized on the plane P4 — ^ ^ 10* 

Remark: When the players have linear valuations and no budget con- 
straint (bi = 00). PSP becomes identical to a second-price auction for a 
non-divisible object. Then the existence of a Nash equilibrium follows di- 
rectly from incentive compatibility. 

Note that in PSP, the incentive compatibility (optimality of truth*telling] 
is in the price dimension, for a given quantity. With the message space we 
Kave designed, there is no single "true'' quantity to dedare, the optimal 
quantity depends on opponent bid prices. Were the message process such 
that players declared a price and a budget (rather than desired quantity), 
it may have been possible to design an allocation rule A such that they are 
inclined to reveal their true budget, thus obtaining incentive compatibility in 
both dimensions, and hence equilibriiun. But such a rule A would likely not 
have a simple closed form like (2) and (3). In essence, the computational load 
of translating budgets into shares would be centrahzed at the auctioneer, 
thus making the system less scalable to large numbers of users. On the 
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FigTue 3: Utility 114(84) for ^1 = (100,1), ^ = (10,2), ^3 = (20,4), 85 - 
(20.7), .^6 = (30, 12) 



other hand, decentralization has a cost too, which is the signaling overhead 
resulting from players possibly adjnstmg bids based on opponent bids in the 
iterated game* Our design is based on the premise that the latter approach 
is the more scalable of the two (indeed that was the reason for choosing a 
small message space). 

The next property is that the tmthfid best reply is cantinnous in op- 
ponent profiles (this can be seen in Figure 2: as the ^^staircase" is varied 
smoothly, the point of intersection with tf- moves smoothly, provided is 
not fiat - which is given by the last time item in Assumption 1). To prove 
that, we wiB need the following: 



Lemma 1 Vj,^' e Sy>fy,i > 0,V^ > 0, -^LJI < * <Aen 

Qi[y + 6. s^,) •^6VI> Qi(y, si.) > Qdv - S,s^i) • sVl, (13) 



Pi{z + 6y/7,s^i]i'S> Pi{2,sli) > Pi{z~SVj,3^i) - L (14) 

Proof: First, ||s_, < 6 implies 5]^^ (ffi-?i| < and pk^-S > pi > pjt-^- 

Thus, J2k9kl{p^^6>y) +*n/7 > Ejb?tl<Pi>») > Efc**l<Pfc-tf>y) ~S^/^. Then, 
using (1) and the ttUMitity (a + A)+ < (c)"*" + (i)*^, the first result follows. 



and 
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For ajiy y < Pi(z, sLi), by (T), we have 2 > Qi(y, ^i^) > Qi{y - ^, - rfv7, 
which by (8J, implies y — < jPi(2 + 5V7,5.,). Letting jr /* P»(j:,5l,), we get 

For any y > i*i(^rs'w)» by (8), we have 2 < Qi{y,s'^i) < Qi(y + ^,^-,) + ^ A 
which by (7) implies y + > Fi{z - ^V7). Letting y \ Fi(z,^^i\ we get 

Lemma 2 (Continuity of best reply) Under Assumption 1, Vt € 1, the €-best 
^piy ti given in Proposition 1 is continwus in s^i on any subset T^'(£, P) = 
{s^ € : > 0,P > >£}, with 00 >7 >£> 0. 

Proof: Let n s sup Gi(s^{), We wi]] show jf^ is continuous, and the continuity of 
V4 s [zi''€/6i{Q)]* and u^j = ^(vt) follow immediately (recal] that by Assumption 
^ is continuous). 

Suppose there is a discontinuity at some Then, Bti > 0, such that > 0, 
3*U' € Vi(£, ?) with - sL^II < 6 and ||zt - z<|| > ci, where = supG<(sl,). 

Suppose 2i + €1 < a:^ = ««p^i(«Lf) (the case ^ 4- ci < z,- b handled identically, 
with 5.1 and interchanged. ). Consider the definition of Gi*; since ^ is decreas- 
ing and 5.f) is non-decreasing and Pii.fS^i) > 0, any point to the left of j{ is 
in the set Gi(*L, )j therefore 



using Lemma 1. 

Also, by (7) Zijr e, < Qi(&l(zi + o ), si..) => ei{zi + f i ) > + f 1, sL .)- Now 
since sL, € VS(£, /»), this last expression is > £ > 0, hence $'i{zi + €1) > 0. Then 
using Assumption 1, B^Zi + €3) > 9<(zi + ei) -f 7<{fi - f^) > ^(a* + fi) + ^, for 
5 < ^1 = ^ A ei7i, and 0 < £2 < (ci - ^iVT) A {ci — S\/ji), Therrfore, since 
Qii ^^^i) is non-decreasing, 



(15) 




+ ci < ^^<(^{^^ + fi) + 6, s.<) + rfvT, 



Zfh<2 < Ot(^(zt+<2),a.i)+*V7-^i +£2 



(16) 



Now (15) also implies that 
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and this holds Ves < fj. Now, using Lemma 1, 



/ [Pi(n.a'.i)-Pi{v.s.i)]dr, 




Let 62 = '^Jw , and C3 such that 0 < cg < ej - {Q^T)hVilt^ Then 



for ^ < ^3- 

Now choosing 5 < 61 A*2, (16) and (17) imply that 3 (ii-K3)A(r,-K2) > 

ztf = sup<?4(^-<), a contradiction. ^ 

We introduce one additional player, player 0, whose valuation is &q{z) = 
poZj and whose bid can therefore be fixed at Sq = (^bjPo) = (QjPo)* Player 
0 can be viewed as the auctioneer, and po > 0 as a 'Reserve price" at which 
the seller is willing to ^'buy" aH of the resource from himself. From (1), the 
presence of the bid 50 = {Q,Vo) implies Vt € 1, Qi{y,s.i) = 0,Vy < po- In 
particular, setting y == 0, the condition of Proposition 1 hcAds. Thus> we can 
restrict our attention to truthful strategies only, and still have feasible best 
replies. This forms a nruthful" game embedded within the larger auction 
game, where the strategy space is T CS, the feasible sets axe 7J O Si{s^)^ 
and the best repLes are JtJ(5) = 7; H Sf(s). A fixed point of in T is a 
fixed point of 5* in Thus an equilibrium of the embedded game is an 
equilibrium of the whole game. 

Propositioa 2 (Nash equilibrium) In the auction game with the PSP rule 
given by (2) and (3) and a reserve price po > 0, and players described by (4) 
and (5), if Assumption 1 holds, then for any € > 0, there exists a truthful 
€-Nash equilibrium <s* 6 T. 

Proof: Vs € T. Vi € I, Vz > 0, we have ^ > 0 = Q.(po/2,s.O. which by (8) 
implies P|(r,«.f) > po/2 = £. Let P = max>€xu^o) ^(0). Then, the conditions 
of Lemma 2 are satisfied and t = (v, w) is continuous in s on T. By Assump- 
tion 1. B'i is continuous therefore v{q,p) = ^(^,^(9)) (as defined in Proposition 1), 




(17) 
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can be viewed as a contimious mapping of ^QY onto itself. By Biouwer's fixed- 
point theorem (sec for example [10]), any continuous mapping of a convex compact 
set into itself has at least one fixed point, i.e. 3g* = i;(9') € [O.QY. Now with 
8* = ^(fl*)). we have c= t(s*) € D 



3.3 Efficiency 

The objective in designing the auction is that, at equilbhum, lesources al- 
ways go to those who value them most. Indeed^ the FSP mechanism does 
have that property. This caa be loosdy argued as follows: for each player, 
the marginal valuation is never greater than the hid price of any opponent 
who is getting a non-zero allocation. Thus, whenever there is a player j 
whose marginal valuation is less than player Vs and j is getting a non- 
zero allocation^ t can take some away from 7, paying a price less than c's 
marginal valuation, i.e. increasing Ut, but also increasing the total value, 
since Vs marginal vake is greater. Thus at equilibrium, i.e. when no one 
can unilaterally increase their utility, the total value is maximized. Formally, 
consider a € aigmaxu The Karu8h-Kuhn-I\icker [17] optimality 

conditions are that there exists a Lagrange multiplier A such that 0{(av) = A, 
if a,- > 0, and ^(0) < A, if a; = 0. 

Assumption 2 For any i € bi = 00, end fl- satisfied 

whenever z > / > 0, 

Given any e > 0, for any €-Nash-equilbrium 5* € T, let a" s 
let fi* s minfgju^o},a,>o o', the smallest non-zero allocation. The foUowlng 
is the version" of the Karush-Kuhn-T^cker conditions. 

Lemma 3 Suppose Assumptions I and 2 hold. If for some j, a* > 

An immediate camllary w that ifg^ > yJtfK then 

A* - 2v^ < e<(aT) < A- + 2v^ 
'If fi is diffeieatisbk, the condition b 0 > 0<' > -ic. 
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if of > \/€Jk and 

e^iat) < A* + 2V«, 

if a* — 0, for some A* > 0. 

Proof: Suppose > 6'j(a'j) + 2v/«. Since fl;(a;) > > pj, we ha^e 

Since a' > 0, if player f bids at a price above p], he can take all of player j'a 
allocation, without losing anything of his own, i.e. a* + aj < Oi(pJi sl<)- By (7), 
this implies 

Let ft = (oT + y/f/it) and sj = (g*, Then 

-«.•(**) = / «J(i)-/',(x.*l<)rfr 

> [^{{o; + ^/^)-p;]^/«A 

> [«J(oJ)-«V^-p;]v/^ 




which contradicts the fact that 5* is an e-Nash equilibrium. O 

Proposition 3 (Efficiency) Svppose Assumptions I and 2 hold. If > 
y/^ftij then ^ 

I • 
whert >l = {a € (O.Q]^+^ : EtCi < 

Proof: (of Proposition 3) Let J+ = {* : o* > aj) and Z" = {* : < cj}. For 
t € I"*", we have ^(cH < + 2Vf3c, For i € J", we have a; > ai > 0, therefore 
hy the lemma, 0'i(a}) > A* - 2V<«. Therefore, 

< (>*-|-2v^A-(A''-2v^)A, 

where A = I^j+(af - a,' ) = - Ct). Since A < Q the result follows, with 

the bound 4Qy/oi. O 



04/15/2004, EAST Version: 1.4.1 



us 2003/0101124 Al 



28 



May 29, 2003 



Remark a: The condition b; = oo is sufficient, but not necessary to 
achieve efficient outcomes. In fact with any budget profile, efficiency can 
be achieved if the users cooperate. For example, if they all choose a bid 
quantity dose to what they can actuaDy obtain (which they do if they use 
the strategv' given by Proposition 1), then the price paid would be po per 
Tsmt for ail the allocations, and if po or ^he shares a* are not too large, 
then budget constraints are irrelevant and a* is efficient. More generally, 
effidenc>' is attained if the budgets are not too far out of line with the 
vaiuations. i,e. there are no players with very high demand and very low 
budget. 

Remark b: {Welfare and Efficiency) A more cominon measure of effi- 
ciency is The sodal welfare, which is the sum of all the players' utility u,-, 
induding the seller i = 0. The natural definition of tic seller's utility is the 
value of the leftover capadty = Q - ^ revenue, i,e. 

«?«> 

Then, Zi = lli^i^i " c.) + «o = Li^^^ + ^(«o) = Ei ^i- Thus, Zi ^ 
is equivalent to the effidency measure used above, which is Another 
measure is the seller's revenue. Even though PSP is not, in general, levenue- 
maxunizing. it tends to the revenue majomizing allocationfi and prices as 
demand increases [18]. 

Remark c: Proposition Z provides a key to understanding the basic 
trade-oiF between engineering .and economic effidency. The smaller f, the 
doser we get to the value-optimal allocations. But in a dynamic game, 
where players iteratively adjust their bids to the opponent profile, a player 
will bid as long as he can gain at least £ utility (since that is the cost of 
the bid), thus a smaller t makes the iteration take longer to converge, i.e. 
entails more signaling. 

ZA Convergence 

An issue of obvious concern js whether the game converges under dynamic 
play: it turns out that it does, when users behave rationally (see Proposition 
4 in Chapter 2 of [29] |. Moreover, irrational or malidous behavior - like 
intentionally trying to prev'ent convergence by making unnecessary bids - 
can always be controlled by setting the bid fee € high enough to make such 
behavior prohibitively costly for the culprit. 
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Figure 4: Paxabalic valuation with k = 0,5 and g = 70 



Another issue is how the convergence time scales with the number of 
bidders. We now consider this experimentally using the software described 
in Appendix B. 

In aJl our simulations we let Q ~ 100. For each user, the valuation is 
strictly increasing and concave up to a maximum corresponding to a physical 
line capacity, and flat beyond that. Since, as shown by Proposition 3, only 
the second derivative of the valuation is needed to measure the efficiency 
of the PSP auction, a second order (parabolic) model is deemed sufficient. 
Thus we use valuations of the form: 

0i(z) = ^Ki{z A ft}V2 + KiOiiz A 

where is the line rate, and Ki > 0 (see Figure 4). 

We generate our user population with independent random variables 
{^(0)}j (corresponding to the maximum unit price the user would pay) 
uniformly distributed on [10,20]^ and Ki ^ ^(0)/9«*, and 9^ uniformly dis- 
tributed on [50, lOOj. AU players have a budget bi = 100, The bid fee is 
fixed at e = 5* Each user has a bidding agent which can submit at most one 
bid per second (see Algorithm 1 in Appendix B). 

With this set-up, the results are shown in Figures 5-6. Simulations were 
run for 11 population sizes ranging from 2 to 96 players. Each point is 
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Figure 5: Mean (+/- std, dev.) number of bids - solid line. The dashed 
line is/ + J^/10. 



simulated 10 times with new random valuations for aD players. The overall 
mean is 11.9 bids per player. From Figure 5, the number of bids seems to 
grow as the square of the number of players. 

The actual time to converge, shown in Figure 6, grows more slowly, since 
the computation of bids is done in parallel by all the players. In fact, for 
small numbers of players, the time decreases. This can best be explained as 
follows. Suppose there are only two players, with similar valuations. They 
will both start by asking for their maximum quantity, at their marginal 
valuation (which at their maximum quantity is near zero). Then a£ each 
sees the other's bid, each will reduce the quantity and increase the price a 
little bit. And they go on taking turns, gradually raising the market price 
until they reach an equilibrium. However if there are 10 players, in between 
two bids by the same player, the 9 others will already have bid up the 
price, so he will jump to higher price than if there was only one opponent. 
Thus the equilibrium market price will be reached more quickly. For large 
populations, this effect becomes small compared to the sheer volume of bids, 
and the convergence time starts to grow. 

The trade-off between signaling and economic efficiency discussed in light 
of Proposition 3 is illustrated by Figures 7-8. Increasing the bid fee speeds 
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Figure 6: Mean (+/- std, dev.) convergence time in seconds (for a 1 second 
bid interval). 

up convergence, at a cost of lost efficiency. A resource manager should select 
a bid fee wliich optimally balances tie two for the particular context. 

Figure 8 also illustrates the validity of the lower bound given by Propo- 
sition 3. 



4 Conclusion 

Auctions are one of oldest surviving classes of economic insti- 
tutions (...] As impressive as the historical longevity is the re- 
markable range of situations in which they are currently used. 
[22] 

We proposed the progressive second price auction, a new auction which 
generalizes key properties of traditional single non-divisible object auctions 
TO the case where an arbitrarily divisible resource is to be shared. We have 
shovm that our auction rule, assuming an elastic-demand model of user pref* 
erences, constitutes a stable and efficient allocation and pricing mechanism 
In a network context. Even though we are motivated by problems of band- 
w idth and buiFer space reservation in a communication network, the auction 
•A-as formulated in a manner which is generic enough for use in a wide range 
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of situations* In the sequel to this work, we show that the key results - 
namely IncentiTe compatibility, equilibrium, and efficiency * generalize to a 
setting where znohiple networked resources are auctioned, with users bid- 
ding on arbitrary but fixed routes and topobgies {29, 31]. In related work, 
we consider the case of stochasticaJly arriving players bidding for advance 
reservations (i-e. resources for a given period of time) [29, 30]. 

An interesting direction of future work is learning strategies, and evolu- 
tionary behavior which can emerge from repeated inter-action between the 
same players. 
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A Information-theoretic basis for the valuation 

In general, valaatioiLS are simply assumed to be given as external factors. 
Indeed, the jEundamental assumptioji in any market theory is that buyers 
know what the goods axe worth to them. The "elastic demand" or *di- 
minishing letnnis" nature of Assumption 1 is fnBy justified from a purely 
economic standpoint for virtually all resources in everyday life. 

In the case of variable bandwidth, we can go even farther by better quan- 
tifying what the goods axe. Ibr a user sending video, say, how much \^ue is 
lost when the channel capacity goes from 1.5 to 1.2 Mbps? Ultimately, the 
value lies not in the amount of raw bandwidth but in the information that is 
successfolly sent. Our goal in this section is to give a brief description of how 
Information Theory can be used for a bottom-up construction of bandwidth 
valuations - based on the fundamental thing the user cares about which is 
communication of information - and that such valuations wll generally be 
of the type in Assumption 1. 

Any information ^source has a function /?{.), such that when compressed 
to a rate Ry the signal has a distortion of at least D(R) [1]. The distor- 
tion is the least possible expected "distance" between the original and com- 
pressed signals, where the minimization is over all possible coding/decoding 
schemes. In this context, we make the distance measure the monetary cost 
of the error. This cost can be chosen, for example, to be proportional to 
some common measures like the mean squared error, the Hamnaing distance 
(probability of error), the maximum error, etc, or heuristic measures based 
on experiments wit! human perception. Given that modem source-coding 
techniques can, given a distortion measure, achieve distortions close to the 
theoretical lower bound[5], it is not unreasonable to use the rate-disrortion 
curve as an indication of the value of the bandwidth share. 

Let D^i.) be the distortion-rate function of {Xi{t)}y a stochastic process 
modeling the source of information associated with user i. Xi is encoded as 
Yi which has a rate of R bits per second. 

Shannon's channel coding theoiem[32] states that 1^* can be received 
without errors if and only if the channel has a capacity C > In our 
auction context, user i has capacity (bandwidth allocation) C = Oi. and 
thus has to suffer a distortion of at least Di{ai). The value of the bandwidth 
is then 

ei(ai}^€i^Di(ai], (18) 
where Ti is the value of the fuU information. 
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The relevant properties of the distortion-rate fiuictioiis are: 

• when the rate is greater than the entropy of the soAirce, the distortion 
is 2eTO, and 

• for many common source models and cost functions, the distortion- 
rate function is convex, and has a continuous derivative. 

It is easy to see that, with these properties. (13) satisfies Assumption 1. 

Example 1: Let {X} be a Bernoulli source, taking two values with 
probabilities p and 1 - p. Wthout loss of generality, let p € [0, 1/2]. In this 
case, since the sonrce is i J.d, one can deiine the distortion on a per symbol 
basis. Using a Hamming cost function 

i.e. assuming it costs one unit of money every time one bit is wrong, we have 
the distortion I) = Ed(X,y) = P{X ^1). the rate-distortion function is 

where ir(ap) = — x log(x) - (1 — x) log(l— x ), and the distortion-rate function 
is the inverse function. It can be easily seen that D(R) is strictly convex and 
decreasing for 0 < A < H[p), and i}(J2) = 0 for A ^ B{py The continuity 
of on 0 < R < H{p) and R > E(jf) is obvious. At the critical point 
(R = ^(p), n = 0), we have 

lim D'{R) = lim l/R!(D) 

« Bm iyiog(i>/l-i>) 

= 0 

= lim D\R). 

Thus continuity of holds throughout, and Assumption 1 is valid for the 
valuation of the form (18) for this source - see Figure 9. 

Example 2: Let {X) be a Gaussian source with Markovian time- 
dependency, i.e a covariance matrix 4> = ^<r'rl'~^l^. , y t € (0. 1 ). Suppose we 
use the squared error cost, i.e. it costs one unit of money for one unit of en- 
ergy in the error signal. Then, we have for low distortions D < (l-r}/(I+r), 
ff(/?) = |logi^,or 
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Figure 9: DistortioB-Tate based valuation for a BeraonHl p = 1/2 source 

and Asfomption 1 clearly holds for (18). In the iJ.d. case (r = 0), the 
formuia holds for all R. 

As the source models get more complex, it rapidly becomes impossible 
to give closed-form expressions for either R{D) or D{R). Often parametnc 
forms are a\:ailable, and the functions can be evaluated numerically. Fortu* 
nately, the convexity property extends to a wide class of models, including 
for example auto-regressiv« sources, even when the generating sequence Is 
non-Gaussian (see [1] for a full treatment of R{D)y including the above 
cases). 

It can happen, e.g. for some video source models, that the R-D curve, 
which gives the best (R,D) pairs achievable by any coder/decoder, Is not 
convex. But, for tractability, practical codecs are usually optimized on a 
convex hull of the space of possible (R,D) pair5[26, 27]- Thus, even when 
the theoretical D(R) curve is not convex, the actual distortion achieved in 
real-life systems cdmost always varies In a convex manner with the available 
bandwidrh. 
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B Simulation software and bidding algorithm 

A prototype softwaxe agent ba^ed implementation of the auction game, 
called TREX, has been developed and extensively used since December 1995. 
Much of the intuition behind the mechanism desi^ and the analysis in this 
work came from experiments done on this inter-active distributed auction 
game on the World Wide Web, using the Java programming language. The 
game can be played in reattime by any number of playOT from anywhere 
on the Internet [28], 

Each user plays in the dynamic auction game using the following: 

Algorithm 1 1 Let Si = 0, onrf i.,* = 0. Start an independent 
thread which receives updates of 5.,-. 

2 Compute the truthful €-best-reply of Proposition 1, ti € ^ O 
5f(s.O. 

3 If'niiti; S^i) > ttt(s{; 5-t) + €, then send the bid Si = t,- 

4 Sleep for 1 second, 

5 Go to 2. 

No assiuaption is made on the order of the turns. Players join the game 
at different times, and depending on the execution context of the dient 
program, the sleep time of 1 second is more ox less approximate. This, along 
with communication delays which make the times at which bids arrive at 
the server and updates at the clients essentially random times, make the 
distributed game completely asynchronous. 

Algorithm 1 can be desaibed as selfish and short-sighted. Selfish because 
it will submit anew bid if and only if it can improve it's own utility (by more 
than the fee for the bid). Thus, the game can only converge'^ to an €-Nash 
equilibrium. And short-sighted because it does not take the extensive form 
of the game into account, i.e. does not use strate^es which may result in a 
temporary loss but a better utiUty in the long run. 
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Chapter 4 



Spot and Derivative Markets in Admission 
Control 

yet game now risk, G. [87] 

In Chapters 2 and 3, we proposed a pure market approach for bandwidth pricings 
where allocated capacities may vary during the lifetime of a flow, as players compete 
for resources through an auction game. 

In this chapter, we propose a mechanism for circuit switched calls, wherein calls 
are admitted or rejected at (or soon after) their arrival time, and if admitted, get 
a fixed allocation of capacity, and have the option of securing the resource at a 
guaranteed maximum price for a guaranteed minimum duration. Thus the charge 
has two components: 

• a market-based usage charge, where the user continuously pays the **instan- 
taneous" market price (determined by second price auctions among recent 
arrivals); if the mcirket price exceeds a user ? bid price, that user is dropped 
unless 

• upon arrival. Liie user pays a reservation fee ibuys an option contract), which 
gives him \\\r right to buy the capacity rfiiy time in the future up to a 
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specified duration ax his bid price. The user pays the market price long as 
it is below his bid price. If at some point during the call, the market price 
exceeds the bid price, then the user automatically exercises the option, i.e., 
remains connected while paying no mote than the bid price. 

In other words, we imroduce a "derivative" instrument to reduce the uncertainty 
inherent in the "spot" narket mechanism. Naturally, this contract (or reservation) 
must itself be sold for a "^air'' price. In the context of financial markets, the fair price 
is calculated with the Black-Scholes approach {8, 65], which is based on the idea that 
the option must be priced such that a perfectly hedged (i.e., riskless) combination 
of the derivative and tie imderlying equity will provide (locally in time) the same 
expected return as a ri=k free security [36] (otherwise the derivative would present 
an arbitrage opponuni"*. i.e., unfair advantage, which would be exploited until its 
price rises). 

In our context, the contract differs in that, rather than the right to buy once at 
a given strike price, it eves the right to buy repeatedly over a given duration, i.e., 
it is a series of "call op:ions". Here the 'fairness" we seek is that the reservation 
be priced in a way tha: reflects the probability that the system will become busier 
during the lifetime of the reservation, in order to avoid individually rational but 
socially sub-optimal behaviour. Spedficaily, we seek to avoid customers connecting 
at low periods and making a reserva,tion linoiting their usage price to an excessively 
low price for a very long time, to avoid rejoining when the prices are higher'. 

A further difference from usual options is that, rather than the standard geo* 
metric Brownian motion model of e.g., a stock price, we have an underlying spot 
market process that is derived directly from our queueing system, via a heavy-traffic 

^ A siitipiified form of thi? arbitrage is commonly observed with fiat-rate priced Oial-up Internet 
access. wUfV*' y^me users ren:ain logged on for vpry \cng periods of time evpii if ihey are not using 
the nelivork. in order lo av.;:d the chance of f5f»tung busy signals when they u^nl to be on. 
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appioximation which leads to a diffusion process. 

From the point of view of the user, this pricing mechamsin is simply an initial 
TeservatioQ fee plus a pei^minute (for example) mage charge. The novelty in the 
networking context is that both are market prices. 

In Section 4.1., we derive a heavy-traffic diifusion approximation model for the 
queueing system. Using that, in Section 4.2., we derive the correspcmding model for 
the spot market price. Then in Section 4.3., we introduce our formulation of the 
reservation as a derivative financial instrument. Finally, in Section 4.4. we present 
some simulation results using a real trace of traffic at' a dial-up Internet access 
modem pool. For the sake of readability, detailed calculations are relegated to 
Sections 4.5. and 4.6.. Although not strictly necessary, a layman's graap of financial 
markets is helpful in reading this chapter. 



4.1» Queueing Model 
4.1.1 Preliininanes 

Customers arrive in a Poisson stream of rate A, with i.i.d. bid prices distributed 
according to a distribution F (density /). Call durations are exponentially dis- 

/r3 
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Figure 4-2: Piicmx Mechanism 



tributed with mean l/r. The queoieing systezi. is shown in Figure 4-1. It consists of 
two stages, with buffers of size B and C resr-ectively. 

The first stage consists of a second price auction, where the winners enter the 
second stage, and the losers leave the syster:. Specifically, the first stage has an 
exponentially distributed service time r wi:z. mean 1/^, At a service completion 
instant, let m be the number of customers iz. the first stage and n the number in 
the second stage, at that time. The m first s-^^ge customers are ranked according to 
their bid prices. The (C— n) highest bids axe accepted into the second stage, and the 
remaining m — (C - n ) are dropped- The bid z rice of the highest dropped bid defines 
the new spot market price, which is valid ui::ii the next batch. If no customers axe 
dropped, i.e., m < C - n, then the spot market price is zero. Figure 4-2 shows the 
functioning of the tnechanism. 

The second stagr is a C server queue r-:h no waiting room, where each cus- 
tomer has an t\xp<jiiential service time (call iuration) of mean l/r. The arrivals 
are according to fi Latch Poisson process, ''".'h rate and batch sizes distributed 
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according to i^m)^- Let /> = X/pi. For 0 < m < J5, 



^„ = P{m arri-vals in r} 



and 



00 




1b Section 4.1.2, the steady-state distribution of the occupanqr of the second 
queue can be shown to be of product form. However, for the purpose of pricing 
the reservaticns, we need a (probabilistic) model of its transient behaviour in the 
future, given :he current price. This is done in Section 4.L3. 

4.1.2 Product-form solution 

Let the staije of the second queue (admitted calls) he X — (A^i,., , , Ajc), where 

Xk = (A'jt.i ^,XkMhh Xk,x is the bid price of the i-th player in the k-th batch, 

Mk is number of calls remaining from the fc-th oldest batch, and K is the number 
of batches present. Let N = H^Li the total number of active calls. The letters 
x^ruk, and r »A'ill denote generic values of X,Mk and iV, respectively. 

X(t} is a .ontinuous time Markov process. The transitions are of two types. On 
one hand \ve have departures of individual customers: 



.r — {xi , - . - 1 ife, • ' • 1 ^k) 



(4.1) 
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occuring with transition probability 

where e{{xk) = (:r*,i , - - . , , xjt,,>3 j . . . , Xk^mk)- ^be other hand, we have batch 
arrivals: 

X = (xi, . . . , lA-) -tar' = (xi, . . . , XK, iK+i), (4.2) 
occuring with probability intensity 

7(x,j') = P^tn^+i n /(^A'+l,t) 
1=1 

if 0 < mjc+i <C and 
if TnA>i = C7 - n. 

Proposition 11 The equilibrium probability of Being in state x = (xj, . . ,jXk) w 
whtrt the normalizaiion constant i$ given by 

urn- T [(ii7)"(f)'/n 
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Proof: To prove the theotem, we liist analyze and then coi^ectnie the trandtioa rates 
7* of the reversed process, X(-i), and then vetiiy that the following balance conditions: 

T(x)7(x, lO = ir(x')7'(«', «), (4.4) 

and Vx, 

i:y(x.^')^J2r{x.x% . (4.5) 
J-' ^ 

hold. Indeed, if (4.4) and (4.5) are satisfied, then by Theorem 1.13 of [46], n is the 
equilibiium probability of the Alartov process X(t), 
CorvjectTire: X(-i) = x has tie following properties: 

« new batches are formed by customers arriving according to a Poisson process of rate 

• arrivals into existing batch k are according to a Poisson process of rate 
Arriving customers have a bid price i.i,d. with distribution F; 

• upon arrival into a batch, if the system is not full (n < C), the customer is placed 
with equal probability in any position within the batch (from 1 to mjt + 1). If the 
system is full, the new customer departs immediately; 

• batch ^ has an exponentially distributed service time, with mean l/>ijfc(x). 
The rates for the reverse process are the following. Firsts 



Second, if n < C or & < /i , 



'^7 



04/15/2004, EAST Version: 1.4.1 



us 2003/0101 124 Al May 29, 2003 

49 



99 



and 

Third- when n=^C, and k = A', i.e., for the last batch when the system is full. 

B 

E 

and 

Xnix) = TTTiK - (4.6) 



Kote that in this last case all the arrivals immediately depart. 

We begin by verii^ing (4,4). For the transitions of type (4.1), i.e., corresponding 
to departures in the forward process, consider a departure irom the ^-th batch. 'When 
mjt > 1, (4.3) yields 

x(xx, . . . , arfc, . . . , xk)t = x(ii , . , . , €,(«*), . . . , aif) ,^^"^!, ^ /(a?Jb,iJr. 

1 + p 

Since wijt - 1 < ^ - 1> we have fimk~i = p'**"V(l + p)"*,and therefore |ijt(ar') = r- rui - 
1)/(1 — p). On the right hand side the system is not ftdl (n' = n — 1 < C - Ij. hence 
Ait(x') = ^ki^)p = i+jK'^^it * 1)- Thus we have 

x(x)r = T(x')^^/(xjb,0. 

Now, since arrivaJs in the reverse process take any position in their batch with equal proba- 
bility. Xk{x*)/mk is precisely the arrival rate into position iin batch k. i.e., Ajt(x')/mA/(iib,{) • 
7"(x'.r). as desired. If = I. {*J.3) yields 

1 +p r 

= t( ri , . . . , xjfc-i T xjt+i , — XK ) Ao/[ a:jt.i ) , 
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For the transiticms oi type (4.2), if 1 < mK+i < C - Ejtsi 



= 7r(xO/i/f+i(a:0, 



as desired. If mjc+i = C - Eits^ "^*ff 



mcmx+1 

= ir(x')/<jtr+i(arOt 



as desired. 

.We now verify (4.5). The left-iand side is the total rate at which the foiwaid process 
X(i) leaves state x, which is p(l - ;?o) + nr. The right-hand side is the total rate of leaving 
state X in the reverse process. Consider lirst a state where the system is not full (n < C). 
The total rate is then (letting k range from 1 to K) 

Ao + J]Afc(x) + /iifc(z) = ;i(l-j3o) + + E /'^^^J^ E 

= /[i(l-..^) + ^r77»jfc = Ml-A) + ''"^ 
k 
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as desired. Now when n = C, tte late is 

= /z(l- A)) + (»-"i;f)r + rmjc-;*jf(i) + A*KW, 



where the second term is derived as in the n < C case above, and the third term comes 
from the definition (4.6). Then tlie tight hand aide is ^(1 - fio) + n^-, as desiied. O 



4,1.3 DifFusion approximation 

We develop a tractable approximation for the queue occupancy process Nu by scal- 
ing the system following the well-known heavy traffic approach {37, 9, 97, 98, 18], 
applied here to a system with batch arrivals. 

Leto4if,milEM = Em=o "lAn, and i = m^j3^. Consider 

asequence of scaled systems, indexed by / = 1,2, . . ., with capacity C^'^ = /or+7>//a, 
where 7 is arbitrary, and batch arrival rate fi^^^ = //i. Let 



(4.7) 



the translated and scaled version of the queue occupancy of the /-th system. The 
drift and diffusion coefHcient respectively are 



d 



—TZ if r < 7 

-r(7 + y/l^) if ^ > 7- 



(4.S) 
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r(l + v^/m + 2/v//q) if ^ < 7 
t(1+7/v^) if2>7- 
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(4.9) 



The basic idea is that as / oo, Z^'^ =^ Zi, (where => denotes weai convergence, 
i.e., the probability distributions converge), where Zt Is the diffusion process which 
solves the stochastic diiTerential equation 



dZt=:a(Z,)dt + a{Zt)dWt, 



(4.10) 



where is a Biownian motion. 

Note that, for 7 < oo, the offered load a^^/C^^^ = (1 + -f/Vla)'^ / 1, which 
makes it a "heavy traffic" approximation. 

The coefficients a(.) aad a^{^ are obtained by letting / 00 in (4.8) and (4.9) 
respectively. In the original approach of [37), ^ Zt holds if ^i(.) and cr2(.) are 
continuous, which is clearly not the case here, since both have jumps at ^ = 7, 
However, based on a theorem of Borovkov [9], Whitt [98] proposes a conditioning 
heuristic to derive approximate steady-state blocking probabilities for the GfGlls}^ 
(i.e., s servers, no waiting room) queue from the diffusion approximation for the 
corresponding G/GIf 00 system. Our approach here will be to apply the heuristic 
to the diffusion process itself^, conditioning on Zt < 7- 



3{08] p. 694 states that» for exponential service times, the heuristic is also applicable to the 
diffusion process itself. 
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4.2. Diffusion Models of the Market Prices 
4.2.1 Spot Price 

Suppose that at time f , the queue occupancy is Nt = n, aad a batch of size m arrives. 
The admission decision is made, and a new spot price results. In this section, we 
want to derive a model which will tell us in some sense the future evolution of this 
price. 

Consider the mechanism by which the price arises. Of the m new customers, 
those with the C ~ n highest hid prices will be admitted, and the spot price will 
be the (C — n 4* l)-th highest bid price. Recall that the bid prices arc i.i.d,, with 
distribution which we assume to be smooth. The probability that the price is x 
is the probability that in m draws, one will equal a;, and of the remaining m — 1, 
C ~n vrill be greater than x, and (m — 1) — (C — n) will be less than or equal to 
which is 

The distribution is 



Jo 

Jo (C-n )l[m- 1 - C + n)l 



Jo (C-/))!(m-l-C + «)! ^ _ « ^ 



where the last equality comes from substituting the previous expression, and making 
the change of variables ii = F{*j)* rlu = f(y) dy. 

Let us consider a "first-ordcr" approximation, the expected spot price given the 
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occupaocy n and tlie size of the batch arrival m: 




where 



ml 



(411) 



(C7-n)!(T7i-l-C + n)! 



4.2.2 Diffusion model of the spot price 

For the purpose of pricing a reservation beginning at time iy we would like to char- 
acterize the future evolution of the market price, in terms of what is known at or 
just before t. namely the occupaacy Nt. Thus, it is natural to consider the process 



Remark; We prefer the above expression to one that uses the information in 
the batch tha: arrives at time since computing the option prices based on the new 
arrivals wouic add to the delay in the admission decision. By not waiting for the 
new infonna::on, we can use the time in between batches for computation of option 
prices. Of course the spot price results froiA the auction among the new bids, but 
that is a very simple computation. 

Xow. we approximate the price by a sequence of fimctions of the centered and 
scalexl process 



B 
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Then, Ito's rule (see, e.g., [45]) along with (4.10) yields the stochastic differential 
equation for P: 

(4.12) 



(4.13) 
(4.14) 

Now (4.12), along with (4.8), (4.9), (4.13) and (4.14), constitutes a diffusion 
model for the spot market price P(, as / -» cso. From the results derived in Sec- 
tions 4.0. and 4,6., we can approximate (4.12) by dP« = 0 when z <'i, and 

^y/Tc (^Pt - Kt^^ m}^ , (4.15) 

when r =r 7. V is a constant related to the accuracy to which we want to evaluate 
^, and can typically can be taken to be 1 (see Section 4,6.). Vm, the constants 
A'}"*'. A'3"*\ which depend only on the bid price distribution F. £u:e defined (and 
can Ik- computed) by (4.23) and (4.25) respectively. 

Remark: ^ = 7 corresponds to A'( = C, i.e,, the system is full. Thiis we have 
a niijilr l where the spot price remains constant when the system is IkjIow capacity^ 



dz 2 dz^ dz 



Since 



^^H^) = E F'\u)g^'\u, V^lz ^ aL m) du, 

where p^'^ is defined as g with C^'^ instead of C, it follows that 

and 



dz^ 



(^) = j2fi^j^F'\u)^g^%u,y/^lz^al,m)du. 
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and varies when the system is full. This corresponds to what one would intuitively 
expect from the auction mechanism (with the constant price 0 when the system is 
not full). Note that we do not attempt to model the transitions between the two 
regimes, so this model is meaningful only during periods when the system is almost 
always full. 

4,3. Computing Reservation Fees: the Derivative Market 

TaJdog the current market price Pt afl initial condition, the solution of (4.15) provides 
a stochastic model of the future prices {Pr}^^^ (this solution is unique in distribution 
- see [45]). From that, we now determine the price of a reservation, arriving at time 
iy with a holding time T, and a bid price p. The value, or "fair price", at time t of 
an option to buy a security for a "strike price" p at a specific future date^ r > < is 
(see (45, 36]) 

Cr = IE(P.-p)^ 

In our context, this concept must be extended in the following straightforward 
manner: we define the reservation as a hold option^ a new kind of derivative instru- 
ment which is an option to buy repeatedly at every time instant from / to 1 + T. 
Thus the reservation fee should be 

<Kt,T,p}^ Crdr. (4.16) 

If /\j = A 2 = 0, (r is given explicitly by the Black-Scholes formula [36]. For the 



^Tfais is called a European optioHf as opposed to an American option, whicli is the right to buy 
at any I iinr between i and r. 
Note thai we take the risk-free interest rale to be 0. 
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moie general form (4.15), which we re-write as 

dPr = (APr-i-K3)di + {DPr+K4)m, (4.17) 

for - > t, with known initial condition Ft, the solution is (see [45], Section 3.6) 




(4.18) 



where 

Sr^exp [{a - i?2/2) (r - t) + J^^DdwJ^ . 

Knowing the set of distributions "Pt = {IP{Pt < x|Pt), Vx : r > t}, we can evaJu- 
ate Ct, for r > ^ and the reservation fee ^ follows. 

4.4. Simulations 

In this section, we simulate the pricing mechanisms presented in the preceding 
sections, applied to dial-up Internet access. 

Our data set consists of all the connections that were made to the Columbia 
University modem pool between April 4th and May 10th 1998. At that time, the 
system, with a total of 316 lines, was very heavily loaded (except for the period 
roughly from 2AM to 7AM every day, essentially aJl lines are always busy). There 
was a total 669,994 calls, from 9451 different users, with an average inter-arrival time 
of 5.59 seconds, and an average call duration of 1299.3 seconds (see Figure 4-3). 

The unsatisfied demand, i.e., the calls which encounter busy signals, are not 
lo2;ged in our data trace, since the blocJcing occurs in the public telephone network. 
Our data trace only includes admitted calls. Thus feeding the trace into a system of 
31 fl lines would result in no blockin;;*. which would not be interesting .since blocked 
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Figure 4-3: Modem pool call statistics (solid) and equivalent - same mean - expo- 
nential distributions (dashed) 

calls are what gives rise to the market price. By scaling down the capacity of system 
in our simulation, we can recreate the congestion. The traffic was fed into a system 
running with 202 lines, of which 18 were allocated to the first stage, and 184 to 
the second stage. The call arrival times and bid durations are from the real traffic 
trace (however the simulation was run at lOx real-time speed), while bid prices are 
randomly generated from F. the uniform distribution on [0, 1). 

Rather than explicitly evaluating the set of distributions functions Vt resulting 
from (4.18), our technique consists of Monte-Carlo siumulation. Specifically, at each 
time when a reservation has to be computed, beginniiig at the known current price 
/t, we generate sample paths by the difference equation corresponding to (4.15), 
which results in a set of histograms (one for each value of t) corresponding to Vo 
Figure 4-4 shows a representative example. 

Since the arrival process is clearly time- varying, the implemented reservation 
mechanism makes real-time estimat<»s of A. and r, to evaluate the constants ^4, As, J? 
and 7\'.|. using the formulas in Section 

I(r7 
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Figure 4-4: Histograras of Pr, for Po = 0 and r = 0, 1, 2 minutes; the bins represent 
price levels (0, 0.1), [0.1, 0.2), . . . , [0.9, 1), 




Figure 4-5: Simulation trace 
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Figure 4-5 shows a snapshot of the simulation trace. The first plot shows the 
number of users arriving in each batch interval, where J = 1 minute. The second 
plot shows the spot price process resulting from the batch auctions. As expected, 
prices axe zero when the system is lightly loaded during the night. The average price 
including days and nights is 0.2055. 

The third and fourth plots show the number of users in the second stage, in the 
reserved and unreserved states. In this simulation, all users accept the reservation 
offer, thus they only remain in the unreserved state for a brief period, from the time 
the offer is sent by the auctioneer (which is a server program), until the acceptance 
returns from the user (which is a client program on a different host). 

In the fifth plot, ^Value" is the simi of the bid prices in the second stage (re- 
served+unreserved): this represents the social welfare, or the total value that the 
users are getting from the system. Without pricing, i.e., if all the users were sim- 
ply admitted on a FCFS basis, the average value during peak periods would be 
184 X 0.5 = 92, since the average bid price is 0.5. Here the average value during the 
day is approximately 110, i.e., the pricing mechanism yields a 20% gain in efficiency. 
In other words, without pricing there are many times when a user who values access 
less is denying a user who values it more. The efficiency is shown more clearly in 
Figure 4-6, normalized so that the horizontal line corresponds to the FCFS system. 
Note that there is an efSciency gain of up to 10% even dtiring off-peak hours, because 
some of the off-peak users arrived during peak hours. 

The sixth plot of Figure 4-5 shows the cumulative revenue from usage charges 
and reser\<ition fees. Since the batch interval is one nainute, and usage charges are 
assessed on a minutely basis, we take the price of 1 as the "full price"' reference level, 
i.e., one niiit of revenue is when 1 line is charged a price of 1 for I minute. The 
unit is i i)l\v(l an MOU (minute-of-use). As can be seen on the plot, ihe revenue for 
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day* 

Figure 4-6: Efficiency; 1.0 = first-come first-served system 

one day is approximately 125,000 MOUs. The 184 lines multiplied by 1440 minutes 
in a day yield about 264,960 potential minutes of use. Thus, on average, a modem 
line generates 0.47 MOUs of revenue per minute, including usage and reservation 
charges. 

Figures 4-7 and 4-8 show how the reservation fee offsets any attempt to "arbi- 
trage". Durations range from 0 to 24 hours, and the reservation fees range from 0 
to 640 MOUs, with the highest ratio being 1 MOU of reservation fee per minute of 
reservation duration, as can be seen by the straight line upper-bounding the scatter 
plot in Figure 4-7. The highest ratio (most expensive reservation) would be for a 
user who gets into the system with a bid price near zero and requests a long reser- 
vation at a time when the arrival rate is high. That is illustrated by Figure 4-8. 
A user asking for a long duration reser^-ation at a low bid price must pay a higher 
fee which compensates for the expected future rise in prices. The vertical variations 
are due to the market price at the moment the reservation offer is made, where the 
higher end are reser\-ations made when the market price is high, 

170 
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Figure 4-7: The raervation fee is at most 1 x duration. 




Figure 4-S: Reservations are proportionally more expensive for low bid prices. 
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4.5. Approximations related to g 

We iiist seek a convenient approximation of (4.11). Fix V > 0. 

4.6.1 Case mu(l - u) > 

By the Central Limit Theorem, the binomial density tends to the normal density, 
i.e., for 0 < ti< 1, we have 

1 r -[fc-(l-u)tnn 



ifc!(m-Jb)! 
Thus, 

giu,n,m) = 



u'»-*(l-ti)*« 



m! 



(C-n)!(m-l-C + n)! 

m-C+n I f -(C-n-(l-t«)mf \ 

.u(l-«) I 2ii(l-u)m /■ 



« ^2«-mu(l - «) 



Differentiation yields 
5ff 



(u,n,m) «^(u,n,m) 



m 



1 C - n - m(l - u) 

- (? + n u(l — u)m 



and 



Vm-C + n/ u{l-ti)mj 



New, recalling that C^^^ = /a + 7\/7a, we get 
(?*''{u,\/o/r + o/,m) » i-i : 
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1 ( -[(7-^)v^-(i-"H' ] 

^^^1 Ml--)'" J- 



'^irTnu(l 

When ^ 7^ 7, as / — * oc the exponential goes to zero faster than the other factors 
grow, thus VSz + a/,m), 0(u,\/q7z 4- aLm) 0. Therefore, by (4.13) 
and (4.14), ^(z) = ^(.)-.0. 
But when 2 = 7, 

0 ' ' ' ' u ^/Wu(l - ti) I 2u J 

1 •|'a(u,V^z4-a/,m) x/S f i - i?('>(«, VSz + a/, m) (4.20) 



dz^ ^ » / i^y^y^ ^3 it(l — u)mj 

/'>(u,v^z + a/,m) (4.21) 



3 

1 as / -+ 00, where indicates that it is an approximation vaLd for large m, 

'» 

j 4.5.2 Case mu(l ~u) <V^ 

Here we consider the neighborhoods of u = 1 and u = 0, where the normal approx- 
imation is no longer valid. Indeed 

^(l,n,m) =m3^cj(n), 

and 

^(0,n,m) = ml^c~m+\}{n), 
where ls(x) = "iii x e S and = 0, otherwise. 



173 
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Thus, for u near 1, we write 



-40 



where 6 is the Dirac-5 function. 

For u near 0, we get the same approximation with 7 replaced hy 7 — which 
becomes identical to the above as / 00. 

HereVz,^(z) = £gJl(.)^0. 



4.6. Approximating the Drift and Diffusion CoefiBcieuts 

When z ^ ')^\yy the results of 4-5.1 and 4,5.2, the right-hand side of both (4.13) 
and (4.14) — » 0, as / 00. Therefore, by the finiteness of (4,8) and (4.9), the 
right-hand side of (4.12) -+ 0, as / 00. 

Thus we need only be concerned with the regime z = 7. Let 



which satisfies «v,mf 1 — ^v,m)m = F^. V can be interpreted as the smallest variance 
at which the binomial distribution is sufficiently close to the normal distribution., 
Typically V can be taken to be about 1. 

Now we will approximate J and its partiaJs in three regions: [0,Tiv,m)- \^n\m^ 1 — 
ui'.mjt and (1 - //i-.„,.l]. 

In the fii-Mi and last regions, as shown in Section 4.5.2, the coeffi<i<*iits tend 
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to 0, Thus we need only focus on the middle region, where the appoximations of 
Section 4,5.1 apply. Also, if 7n< 4V^, uv,m is not real, and in fa<:t we are always in 
the case of Section 4.5.2, where the coefficients tend to zero. Thus we have non-zero 
terms only when m > AV^. 

Writing a^'^ = -r{-f + y/Ia) = -rC/Vla, and plugging (4,20) into (4.13), we get 

dz Av.« \m uJ 

J'S.p{>)^rCK!r\ (4.22) 
m 

as / CO, where 

Av.„ 'u « ^2xTnm-«) I 2u J 

= r'^' F-\-^)!^^Se-^'^dw (4.23) 

where the second line follows firom a change of \'ariables w = -^(1 — u)m/«, 



i/;!""' = y/(l-uv,m)m/viv.r 



and 



Similarly, using o-^''^ = r(l +i/y/la) = rC/(/a), and plug^g (4.21) into (4.14) 
leads to 



ml f —(1 - u)m\ , 
e\'p — — ) du, 

/7r 



04/15/2004, EAST Version: 1.4.1 



us 2003/0101124 Al May 29, 2003 

67 



117 

rC{-2Kt^/B + Kt^) (4^) 

as / — + oo, where 

m 1 f -(l-Ti)m l 
^ ^2rmu(l - ti) 1 2u J 



Finally, 



Substituting all of the above into (4.12) yields (4.15). 
4.6-1 Example: F uniform 

Suppose F is the unifonn distribution on [0, P]. Then F-^(^^) = hence 

where $ is the nonnal distribution of mean zero, and variance 1. Also, 
/^^^ = p/j."'(u,Vm + l-l/m-l/t«^)y|e-'^/2da; 

f74 



{">> 
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4.7. Optimal Seller Strategies 

In this section, by way of conclusion, we briefly outline approaches to the comple- 
meotary control problem, i.e., how the seller can ''tune" the mechanism in order to 
optimize some system- wide objective. 

Taking the above mechanism as a given, consider the optimal strategy for the 
network manager, whose objective is to maximize revenue, using ^{P) 6 [0,oo] 
as the (feedback) control. As the spot market is governed by auctions, P = 0 
whenever the system is not fuU. The relevance of the problem is during periods 
when the system is heavily loaded (i.e., almost always full). Then, the objective is 
equivalent to minimizing 

Jis,v,(i) = -£ Ptdt, 

over aH admissible controls fi{t) = pt[P]. r is the stopping time r = inf{^ > J ; Pt = 
0}, and the initial state is P, = y. The dynamic programming equation is 

dW 
OS 

for y > 0, and W(s,0) = 0. The differential operator A is given by [20] 

If is a solution of the above equation, then the optimal cost is J(5,y,/i') = 
VK(5,y), and, in the classical approaches, the optimal control is obtained by per- 
forming the minimization over pL, In this case, even when W can be solved for, 
or guessed, for each y finding the control fi{y) is in general not tractable since it 
involves polynomials of degree BU 

There are a number of promising approaches lo this control problem. It is inter- 
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esting to investigate the applicability of approximation techniques by discretizing 
the original problem, and solving :t as a Markov-decision problem, in the manner 
of [53] as well as that of [81], and compare the resulting performance with the opti- 
mal open-loop control- One should also consider some heuristic solutions based on 
related but simpler solvable problems, and investigate the relationship of the opti- 
mal control with the notion of BroTmian local time, as in [11], Finally, the trade-offs 
between optimality and computational complexity should be investigated. 
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What is claimed is: 

1. A method for real-time market-based resource alloca- 
tion, comprising: 

receiving at least one bid in real-time for a resource; 

deciding which of the at least one bids has won the 
bidding; and 

controlling the resource so that it is committed to the 
winning bidder. 

2. The method of claim 1, wherein the resource is band- 
width. 

3. The method of claim 1, wherein the resource is buffer 
space. 

4. The method of claim 1, wherein the resource is pro- 
cessor time. 

5. The method of claim 1, wherein the resource is con- 
trolled in real-time so that the winning bidder has access to 
the resource he has won as soon as bidding closes. 

6. The method of claim 1, wherein the bid is received firom 
a software agent. 

7. The method of claim 6, wherein the software agent bids 
in accordance with a strategy rule. 

8. The method of claim 7, wherein the strategy rule is a 
truthful best reply strategy. 

9. The method of claim 6, wherein the software agent bids 
in accordance with a valuation rule. 

10. The method of claim 9, wherein the valuation rule is 
determined in accordance with al least one measured net- 
work parameter, 

11. The method of claim 6, wherein the software agent 
bids in accordance with an allocation rule. 

12. The method of claim 1, wherein deciding which bid 
has won the bidding is performed in accordance with an 
allocation rule. 

13. The method of claim 12, wherein deciding which bid 
has won the bidding is performed in accordance with a 
market allocation rule also used by a buyer software agent, 
the market allocation mle defining the rules of the resource 
market. 

14. The method of claim 12, wherein deciding which bid 
has won the bidding is performed in accordance with an 
English Auction market allocation rule. 

15. The method of claim 12, wherein deciding which bid 
has won the bidding is performed in accordance with a 
continuous bid-ask trading market allocation rule. 

16. The method of claim 12, where deciding which bid 
has won the bidding is performed in accordance with a 
progressive second price auction allocation rule. 

17. The method of claim 12, where deciding which bid 
has won the bidding is performed in accordance with a hold 
option allocation rule. 

18. The method of claim 1, further comprising: 

storing information concerning which bid has won, for 
accounting purposes. 

19. The method of claim 1, wherein there are several 
resources, and a respective resource agent performs the 
elements of claim A for each resource. 

20. The method of claim 1, wherein there is one resource, 
and a single resource agent performs the elements of claim 
1 for the resource, 

21. The method of claim 1, wherein the elements of claim 
1 are performed by a resource agent executing on a separate 
computer than the placing the bids. 



22. The method of claim 1, wherein the elements of claim 
1 are performed by a resource agent executing on the same 
computer as at least one placing at least one of the bids. 

23. The method of claim 1, wherein the is controlled by 
a human being, who decides how to bid. 

24. The method of claim 1, further comprising: 

deciding, by a bidder agent, how to bid based on a 
valuation function of the bidder agent and a strategy 
algorithm of the, 

25. The method of claim 1, further comprising: receiving 
an offer to sell resources from a seller agent. 

26. The method of claim 1, further comprising: 

receiving player agents in a garage of a resource agent and 
receiving bids from player agents in the garage. 

27. The method of claim 1, wherein the bid is received 
from a player agent that also submits offers to sell resources. 

28. The method of claim 1, further comprising: 

before bidding, receiving a request from a buyer software 
agent for a location of resource agent. 

29. The method of claim 1, further comprising: 

sending at least one bid in real-time for a resource; 

receiving a notification that the sent bid has won the 
bidding; 

selling the use of the winning resource to third parties 
through a separate resource agent; and 

notifying a resource management and control agent that 
the third parties will be using the resource. 

30. A method, performed by a mtiltiagent, comprising: 

sending at least one bid in real-time for a resource in 
accordance with a strategy rule and a valuation rule of 
the multiagent and in accordance with a system-wide 
aUocation rule; 

receiving a notification that the sent bid has won the 
bidding; 

selhng the use of the wiiming resource to third parties 
through a separate resource agent; and 

notifying a resource management and control agent that 
the third parties will be using the resource. 

31. A method, performed by a buyer agent, comprising: 

sending at least one bid in real-time for a resource in 
accordance with a strategy rule and a valuation rule of 
the buyer agent and in accordance with a system-wide 
allocation rule; 

receiving a notification that the sent bid has won the 
bidding; and 

making use of the resource in real time, immediately after 
winning the bid. 

32. The method of claim 32, wherein the system wide- 
allocation mle is a PSP allocation rule. 

33. A system for real-time market-based resource alloca- 
tion, comprising: 

means for receiving at least one bid in real-time for a 
resource; 

means for deciding which of the at least one bids has won 
the bidding; and 



04/15/2004, EAST Version: 1.4.1 



us 2003/0101124 Al 



71 



May 29, 2003 



means for controlling the resource so that it is committed 
to the winning bidder. 

34. A system for real-time market-based resource bidding 
by a multiagent, comprising: 

means for sending at least one bid in real-time for a 
resource in accordance with a strategy rule and a 
valuation rule of the muldagent and in accordance with 
a system-wide allocation rule; 

means for receiving a notification that the sent bid has 
won the bidding; 

means for selling the use of the winning resource to third 
parties through a separate resource agent; and 

means for notifying a resource management and control 
agent that the third parties will be using the resource. 

35. A system for real-time market-based resource bidding 
by a buyer agent, comprising: 

means for sending at least one bid in real-time for a 
resource in accordance with a strategy rule and a 
valuation rule of the buyer agent and in accordance 
with a system-wide allocation rtile; 

means for receiving a notification that the sent bid has 
won the bidding; and 

means for making use of the resource in real time, 
immediately after winning the bid. 

36. The system of claim 35, wherein the system wide- 
allocation rule is a PSP allocation rule. 

37. A system for real-time market-based resource alloca- 
tion, comprising: 

a portion configured to receive at least one bid in real-time 
for a resource; 

a portion configured to decide which of the at least one 
bids has won the bidding; and 

a portion configured to control the resource so that it is 
committed to the winning bidder, 

38. A system for real-time market-based resource bidding 
by a multiagent, comprising: 

a portion configured to send at least one bid in real-time 
for a resource in accordance with a strategy mle and a 
valuation rule of the multiagent and in accordance with 
a system-wide allocation mle; 

a portion configtired to receive a notification that the sent 
bid has won the bidding; 

a portion configured to sell the use of the winning 
resource to third parties through a separate resource 
agent; and 

a portion configured to notify a resource management and 
control agent that the third parties will be using the 
resource. 



39. A system for real-time market-based resource bidding 
by a buyer agent, comprising: 

a portion configured to send at least one bid in real-time 
for a resource in accordance with a strategy mle and a 
valuation rule of the buyer agent and in accordance 
with a system-wide allocation rule; 

a portion configured to receive a notification that the sent 
bid has won the bidding; and 

a portion configured to make use of the resource in real 
time, immediately after winning the bid. 

40. The system of claim 39, wherein the system wide- 
allocation rule is a PSP allocation rule. 

41. A computer program product, including instructiop s 
for causing a dat^rocessing device to perf orm actions for 
real-tiine marKet- bSei^es our ce ailocat^^ comprising: 

receiving at least one bid in real-time for a resource; 

deciding which of the at least one bids has won the 
bidding; and 

controlling the resource so that it is committed to the 
winning bidder. 

42. A computer program product, inc luding instructiops 
for causing a multiagent of a data processing device l o 
perform actions for real-dme market-based resource bid- 
d ing, comprising: 

sending at least one bid in real-time for a resource in 
accordance with a strategy rule and a valuation rule of 
the multiagent and in accordance with a system-wide 
allocation rule; 

receiving a notification that the sent bid has won the 
bidding; 

selling the use of the winning resource to third parties 
through a separate resource agent; and 

notifying a resource management and control agent that 
the third parties will be using the resoxirce. 

43. A computer prog ram product, including instructi ons 
fo r causmg' a buyer agent ot a data proggsaiog devicaJsL 
p erform action for real-time market-based resource_biddi ng, 
comprismg: 

se nding at least one bid in real-time for a resource in 
Ac cordance with a strategy rule and a valuation rule o f 
the buyer agent and in accordan ce with a system.- widc 
al location rule; ~~ 

receiving a notificati on ^^^^ ^he 
b idding; and 

m ^ng use of the r f^niirn* in n^til tim*^, ir^TnnHi'nfply after 
winnj^ pg thp. hid 

44. The computer program product of claim 43, wherein 
the system wide-allocation rule is a PSP allocation rule. 

« « * * * 
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